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This is the third and final report published on the Employment 
Preparation Program (EPP) and the Experimental Work Experience Program 
(EWEP) in San Diego, California, as part of MDRC's multi-state 
Demonstration of State Work/Welfare Initiatives. States participating in 
this project — in addition to California ~ include Arizona, Arkansas, 
Florida, Illinois, Maine, Maryland, New Jersey, Texas, Virginia and West 
Virginia. 

The Demonstration of State Work/Welfare Initiatives is a unique oppor- 
tunity for MDRC to work closely with a number of states in evaluating their 
employment programs, while at the same time examining a subject that is of 
national as well as state concern: the critical relationship between work 
and dependency. Addressing state issues in a manner that benefits policy 
at many levels is a challenge that MDRC is privileged to be undertaking. 

in order to understand this project, one must realize that this demon- 
stration documents ar. important shift in program responsibility away from 
the federal government to the states. The studies evaluate the initia- 
tives states themselves chose to implement under the provisions of the 
Omnibus Budget Reconciliation Act (OBRA) of 1981, in which they received 
authority for the first time to operate Community Work Experience Programs 
(CHEP) for recipients of Aid to Families with Dependent Children (AFDC) and 
to streamline the administration of their Work Incentive (WIN) systems. 
Because states responded to these options in different ways, the 
demonstration is not built around a single model. Rather, the initiatives 
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represent some of the major variations being tried in thi0 country and span 
a range of local economic conditions and AFDC program pro^^iona. 

Most states are receiving two reports over the couf^e of the demon- 
stration; California, with three, is the exception. fo* first covered 
early issues of implementation and participation. The **<*ond updated the 
implementation bindings and presented interim program impacts and the 
results of a short-term benefit-cost study. In this third ^nd last report, 
the final longer-term impact and benefit-cost results ar^ discussed, with 
particular emphasis on the cost-effeotiveness of the San p^go approach* 

MDRC could not have conducted this demonstration without the support 
of The Ford Foundation, which provided funds for the planr^g stage and for 
the evaluation activities of the participating states, Etching an equal 
investment of state or other local resources. Thi* joint funding 
relationship is another significant aspect of t^e demonstration effort. 

In the implementation and early analysis of the Demonstration of State 
Work/Welfare Initiatives, MDRC has been gratified by the ^stained commit- 
ment of the participating states and foundations and theif interest in the 
early findings. It is our hope that the results of this demonstration will 
contribute to informed decision-making and ultimate}? lead to the 
development and operation of more effective programs desired to increase 
the self-sufficiency of welfare recipients. 

Barbara 0* Blum 
President 
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EXECUTIVE SUMMARY 



This report presents the findings from a three-year study of two San 

Diego demonstration prcjects ~ one involving a Job search requirement, the 

other combining that requirement with a short-term work obligation. 

Overall, compared to the few earlier studies on similar approaches, the 

results are favorable. The San Diego programs successfully implemented a 

short-term participation requirement for new applicants to welfare. For 

* 

applicants to Aid to Families with Dependent Children (ADFC) — mainly 
female single parents who constitute a majority of the welfare caseload — 
both programs increased employment and proved cost-effective for both the 
applicants and taxpayers. The programs were particularly effective for 
individuals often ignored by employment and training programs: those whose 
characteristics define them as difficult to employ. 

For the AFDC-U applicants — primarily men from two-parent households 
— the results are mixed. Both programs substantially reduced welfare 
costs but did not increase employment significantly, with the result that 
taxpayers gained but the welfare applicants did not. A final Judgment on 
the programs 1 effectiveness for this group depends on the relative weight 
given to these outcomes. 

These results deserve attention because of their reliability. San 
Diego successfully implemented an unusually strong evaluation design, based 
on rigorously executed random assignment. As a result, the findings offer 
valuable evidence on the potential and limits of job search and work 
experience in increasing employment and reducing welfare dependency. 
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Since 1982, San Diego has operated two innovative employment initia- 
tives designed to increase unsubsidized employment and reduce welfare 
dependency and costs. The two programs drew on past experience in 
California, as well as on the opportunities offered by the federal Omnibus 
Budget Reconciliation Act of 1981 (OBRA) , that gave states and localities 
more flexibility to design and manage welfare employment programs. 

Participation in San Diego's two program models, which were imple- 
mented by the State Employment Development Department (EDD) and the County 
of San Diego Department of Social Services (DSS), began at the point of 
welfare application. The main features of each were: 

Job Search, One-day placement assistance provided at the 
welfare office preceded registration with the Employment 
Preparation program. EPP was a three-week job search workshop 
offering one week of orientation and training and two weeks of 
self-directed job-search in a group setting in order to 
improve participants* job seeking methods. 

Job Search/Work Eyp^rienoe. Following the job search work- 
shop, those still unemployed and .on welfare were requiced to 

participate in the Experimental Work Experience Program 
(EWEP) , involving an unpaid position in a prblic or private 
nonprofit agency for up to 13 weeks. Monthly work hours were 
determined by the family's welfare grant divided by the 
minimum wags. 

The job search workshops were similar tc other job clubs implemented 
in California and elsewhere by the Work Incentive (WIN) Program, the 
federal/state employment and training program for welfare recipients. The 
work experience followed the federal OBRA option in that work hours were 
determined by the family's welfare grant, and the work positions were 
intended to enhance participants 1 employability and skills. However, the 
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San Diego approach restricted the work obligation to those on welfare who 
completed job search without employment and further limited its duration 
(13 weeks) and its weekly work requirement (32 hours). 

Both programs were required for all new WIN-mandatory applicants to 
the AFDC program — both heads of two- parent (AFDC-tf) households and, in 
most cases, heads of single-parent (AFDC) households in which the youngest 
child was age six or over. Failure to participate without good cause could 
lead to denial of the welfare application or to a temporary loss of bene- 
fits (i.e., sanctioning). Since the programs sought to impose a general 
participation and work requirement on all able-bodied welfare applicants, 
eligibility criteria were explicitly broad, and only a few groups (e.g., 
union members or those with language difficulties) were excluded from 
participation. 

The Study Design and Satnnl* 

This report is the last of three in the overall evaluation of the San 
Diego initiatives. A first report indicated that the two approaches were 
successfully implemented and that the reactions of participants were 
positive. A second report assessed operational performance and presented 
interim estimates of program impacts, as well as benefits and costs through 
December 1983. This final report presents impact estimates for the full 
sample for up to two years following welfare application, and a 
benefit-cost analysis covering a five-year time span. The major focus is 
on the following questions in the impact and benefit-eost studies: 

Impact Study 

• How effective was each program in increasing employment and 
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earnings and reducing welfare receipt and payments? 

• Did the addition of work experience (EWEP) to job search (EPP) 
have incremental effects on employment and welfare behavior? 

• What was the pattern of the impacts: Here they consistent 
aoross time periods? Did they increase in size, or tend to 
decay over time? 

• For whom did the programs work best? What were the results 
for those differing in prior employment experience, welfare 
dependency and other selected characteristics? 

Benefit-Coat Sfcurlv 

• For each of the two programs how did measurable benefits 
compare to the costs? 

• What were the gains and losses to welfare applicants and 
taxpayers (i.e., everyone other than the applicants), and for 
society as a whole? 

• What was the net budget impact of these programs? How were 
the benefits and costs distributed among the federal, state 
and local levels of government? 

• For whom were the programs most cost-effective? For example, 
did those with limited or more extensive prior employment 
benefit most? 

To obtain reliable estimates of program effects, an experimental 
design was used whereby eligible welfare applicants were randomly assigned, 
to one of two experimental groups — Job Search only or Job Search/EWEP ~ 
or to a control group offered minimal WIN services. Random assignment took 
place at the point of welfare application between October 1982 and August 
1983* Because the groups had comparable background characteristics, any 
statistically significant differences between them could be safely 
attributed to the programs' treatments. Data were obtained from 
computerized AFDC payment and Unemployment Insurance earnings and benefit 
records, as well as from program tracking, fiscal and administrative 
records. 
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The research sample contains 6,997 applicants, with almost equal 
proportions of AFDC and AFDC-U applicants. The AFDC sample was predomin- 
antly female and had a more limited work history and greater prior welfare 
dependency than the primarily male AFDC-0 group. Because of these 
differences, as well as the different federal regulations for the two 
assistance categories both of which were expected to affect outcomes — 
the AFDC's and the AFDC-0 1 s were analysed separately. It is also 
noteworthy that, since the San Diego programs were directed to new welfare 
applicants, not on-board recipients — and were further restricted to 
applicants with school-age children ~ the majority of the existing San 
Diego caseload was not covered by these programs. In addition, the San 
Diego welfare population studied was less disadvantaged than the welfare 
population nationally. The findings of this study may therefore not be 
representative of a welfare population with different background 
characteristics. 

One other point should be emphasized. Since many believe that a 
participation requirement will deter individuals from completing their 
welfare applications, random assignment was conducted at the point of 
application, not welfare approval or program registration. Program impacts 
and benefit-cost findings are therefore expressed as averages per applicant 
for a large sample of people including those who for various reasons did 
not participate (roughly half) or were not approved for welfare (about 15 
percent). Thus, even relatively small changes per applicant imply changes 
for the overall caseload that have considerable policy significance. 




Finding s on Participation and Program Implementation 

• San Diego succeeded in operating a short-term participation 
requirement for the vast majority of the program registrants. 
Participation rates were substantial, and by nine months after 
welfare application, all but a small proportion had left 
welfare, become employed, met the programs 9 requirements, or 
rrere deregistered from the programs. 

Overall, about nine-tenths of those randomly assigned to the experi- 
mental programs registered with them; and over half these registrants took 
part in some program activity, primarily Job search, within a nine-month 
follow-up period. Most of those eligible for work experience were referred 
to it, and most worked in an EWEP Job. This means that about one-fifth of 
all applicants who entered the experimental sample at welfare application 
participated in the mandatory work experience. The overall participation 
rate met or exceeded the participation rates previously achieved in special 
tests of mandatory work experience. 

However, the ultimate goal of the San Diego programs was to reduce the 
size of the welfare rolls, not to maximize program participation. Thus, 
any conclusion about operational success must consider not only how many 
applicants participated, but what happened to those who did not. Overall, 
after nine months, all but 9 percent of the AFDC's and 6 percent of the 
AFDC-U's who had initially registered with the programs had either 
fulfilled the requirements or were no longer subject to them: they had 
found Jobs, were deregistered, or were no longer on welfare. Many of the 
small group who had not fulfilled the requirements had been excused for 
health or other reasons. In contrast, among control group registrants, 24 
percent of the AFDC's and 17 percent of the AFDC-U's had not met the very 
limited requirements of WIN, become employed, or left welfare. 
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• To implement a participation requirement, staff were 
persistent in their review of registrants 1 activity and 
recommendation of sanctions. 

Program staff granted few exemptions and deferrals and were careful to 

identify instances of non-cooperation with program requirements. While 

staff first encouraged participation, they sought sanctions for those who 

were nonoompliant. The rates of requested sanctioning were considerably 

higher for participants in the two experimental programs (ranging from 4 to 

8 percent) than for controls in the more limited WIN Program (1 percent or 

less) • 

• Work experience (EWEP) Jobs were viewed as valuable and not 
"make-work, » although they did not lead to substantial skills 
development. Participants generally believed the work require- 
ment was fair and were judged to be as productive as regular 
workers. 

Most of the work experience jobs were entry-level clerical, mainten- 
ance, parks and health positions. Convenient location was a primary factor 
in making assignments, with individual interest also important. In a 
survey of a subsample of worksite participants and their supervisors, parti- 
cipants were generally found to possess needed skills when they began their 
assignments; those who did not, acquired them during their EWEP experience. 
Supervisors found that EWEP participants were as productive as regular 
workers in the same entry-level wage range. The great majority of worksite 
participants surveyed expressed satisfaction with their Jobs and also 
indicated that the requirement to work was fair. 

Findings on Progra m Impacts 

The impacts of the Job Search and the Job Search/EWEP programs were 
estimated by comparing the outcomes of applicants in each of the two experi- 
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mental groups to the outcomes of the control group. The incremental impact 
of adding the EWEP work requirement to the Job Search workshops was 
determined by comparing the outcomes of the two experimental groups. Tests 
of statistical significance indicated how likely it was that measured 
differences resulted from the program interventions rather than by chance. 

Most impacts were estimated for the full sample of welfare applicants, 
TWo subsamples were also considered: (1) the early applicant group (who 
applied for welfare pric- to April 1983), tracked for about two years, and 
(2) later applicants (who applied for welfare from April to August 1983), 
tracked for a year and one- half. 

Impacts on AFDC Applicants 

• The Job Search/EWEP sequence led to substantial increases in 
employment and earnings for the AFDC assistance category. 
These gains were sustained over time and were consistent for 
the early and later applicants. 

As presented in Table 1, the Job Search/EWEP program had statistically 
significant impacts on the proportion of AFDC applicants employed (5.6 
percentage points) and the amount of their earnings ($700 per experimental) 
over a five-quarter follow-up period. This earnings increase represents a 
23 percent gain over the control group average earnings of $3,102, 
Further, these impacts were sustained over all quarters in the follow-up 
period and, except for a slight decline after quarter 3, remained fairly 
stable (see Figure 1). 

A comparison of the early and later applicants indicates that the 
groups experienced similar employment and earnings increases. Moreover, 
the employment and earnings impacts for the early group persisted for two 
years (through quarter 8). 
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FIGURE 1 

AFDC APPLICANTS: TRENDS IN QUARTERLY EMPLOYMENT 
RATES FOR THE FULL SAMPLE 



'ercent Employgd 
' 60 



50 



40 



30 



20 



10 




0 — 



U cation 



IRCE: See Table 3.2. 



Quartor RglativG to Application 



Job Search-EWEP 
Experimental 



Job Search 
Experi mentals 



Controls 



21) 



• The Job Search/EWEP program respited in modest welfare savings 
for the AFDC group, but these decayed over time. 

Welfare savings were modest but statistically significant for the Job 
Search/EWEP group: the total 1 8-month reduction in welfare benefits was 
♦288 per experimental. The evidence indicates that the programs did not 
deter individuals from continuing with their welfare applications: similar 
proportions of both the Job Search/EWEP and control groups received welfare 
at some point during the 18-month period. Despite this, there were 
quarterly reductions in the proportions receiving welfare and reductions in 
welfare payments (see Table 1). These reductions were highest d?*ring the 
year after welfare application, and smaller thereafter. 

The patterns of welfare impacts were similar for the early and later 
enrollees. An examination of the early sample showed continued small 
benefit reductions through quarter 8, although these reduction:; were not 
statistically significant. 

• Overall, the Job Search program improved employment and, to a 
lesser extent, earnings for the AFDC group, but these impacts 
were not consistent. While the early applicants recorded 
substantial gains, the later applicants, surprisingly, 
experienced a loss in earnings. 

As seen in Table 1, the Job Search program increased employment for 

the full sample by the same proportion as the Job Search/EWEP sequence — 5 

percentage points — but the earnings gain of $251 was much smaller and not 

statistically significant. For both early and later applicants, Job 

Search produced its greatest employment gain in the quarter after welfare 

application. 

While the early sample experienced these gains throughout the 
follow-up, the later sample members did not (see Figure 2). For the early 
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FIGURE 2 
AFDC APPLICANTS: 
TRENDS IN QUARTERLY EMPLOYMENT RATES, BY APPLIUjION PERIOD 
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applicants, over the five-quarter follow-up period, there was a 6 
percentage point gain in employment and a $817 increase in earnings, both 
of which were statistically significant and similar to the short-term 
findings in the interim report. These gains continued through quarter 8. 
In contrast, the later enrollees' employment gain of 3 percentage points 
was not statistically significant, and this group took a large average loss 
in earnings of $670, an amount that is statistically significant. This 
deterioration in earnings for the later Job Search group came from their 
failure to retain Jobs. Compared to controls, a higher proportion had lost 
jobs without finding new employment. 

• The Job Search program produced modest welfare savings which 
were not sustained over time but were consistent for both 
samples. 

As shown in Table 1, the reduction in welfare benefits for the full 
sample was $203 over the 1 8-month follow-up — only slightly lower than the 
reduction achieved by the Job Search/EWEP program. Impacts were largest 
and statistically significant in the third quarter. Thereafter, these 
effects moderated so that, by the sixth quarter, there were no additional 
savings. Welfare savings were similar for both early and later enrollees, 
despite different employment impacts. 

• These results lead to the strong conclusion that Job search 
followed by a short-term work requirement is an effective 
program sequence for AFDC's. The effects of Job search alone 
in San Diego, though positive, were less consistent. The 
effectiveness of EWEP beyond the workshops thus remains 
unclear. 

For the full sample, the earnings gain from EWEP (above those of Job 
search) was a statistically significant $449 over the five-quarter period. 
However, the additional EWEP earnings effect was not consistent for early 
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and later applicants. No additional impacts occurred for the early 

enrollees, but a large earnings gain was found for later applicants, 

amounting to a statistically significant five-quarter earnings increase of 

$1,292. This finding was driven by the poor employment and earnings 

outcomes of the later Job Search experimental s compared to both the Job 

Search/BfEP and control groups (both of whom showed notable employment 

increases as the labor market recovered from an earlier recession). EWEP 

had no incremental effects on welfare receipt or the level of payments for 

the full sample or for either group of applicants. 

There is no clear explanation for the differential behavior of the 

early and later Job Search groups. The report discusses a nunber of 

factors that may explain these findings, including changing labor market 

conditions (from a severe recession to a later, stronger economy), changing 

characteristics of applicants (related to this labor market shift), a 

change in program operating procedures (although none was obvious), or 

simply, random chance. A full explanation probably includes many factors. 

• Analysis of selected subgroups confirms the .findings from 
other studies that employment programs for welfare recipients 
have larger impacts on those who are more disadvantaged — 
that is, those with no recent employment experience or with 
some prior welfare dependency. 

Impacts on employment and earnings were concentrated among the most 

disadvantaged subset of applicants — those in the sample who did not have 

earnings during the year prior to welfare application. The study shows 

that, on their own, controls with no recent employment earned considerably 

less and received more welfare than those who had been employed. For the 

Job Search/EWEP group with no recent work history, the average earnings 

increase over the five quarters was $1,066, three times the gain of 
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experimental^ with some recent employment. The pattern was substantially 
the same for the Job Search group, although the differences between those 
with and without a work history were generally not as large. Welfare 
savings were similar for the two groups. 

Earnings and employment gains were also generally higher for those who 
had received some welfare prior to application than for those who had not. 
The story was mixed on welfare savings, but, in general, reductions in 
welfare payments were slightly greater for those with prior welfare 
dependency. 

Impacts on AF DC-U Applicants 

The results for the AFDC-U's are in marked contrast to the findings 

for the AFDC's: neither program significantly increased the employment or 

earnings of AFDC-U's, although both substantially reduced their welfare 

payments. Moreover, the addition of mandatory work experience to job 

search did not produce any incremental effects. It is also worth noting 

that the timing of the welfare application did not appear to substantially 

influence outcomes, as it did for the AFDC's. 

• For both program models, there were statistically significant 
and substantial reductions in welfare payments, but no 
significant impacts on the employment and earnings of AFDC-U 
applicants. 

Both programs produced small impacts on employment and earnings that 
were not statistically significant. Over the five-quarter follow-up 
period, earnings increased by $216 for Job Search/EWEP experimentals and by 
$384 for the Job Search only group, as shown in Table 2. In contrast, the 
18-month welfare savings were substantial and statistically significant. 
During this period, the Job Search/EWEP sequence led to a reduction in 
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welfare payment*, of $530, about a 15 percent reduction in benefits. A 
slightly smaller reduction of $470 was found for the Job Search group. The 
impacts were roughly the same for the early and later groups of applicants. 

There are several possible explanations for the large welfare savings 
with negligible employment gains. Sanctioning rates were higher for 
experimental than controls, and those sanctioned faced larger grant 
reductions than did AFDC f s. For AFDC-U 1 s, even modest increases in 
employment — given the program f s eligibility rules — could have triggered 
relatively large welfare savings. It is also possible that the initial 
employment impact (which later disappeared) led to longer-term welfare 
savings as AFDC-U applicants who subsequently lost Jobs die?, not return 
immediately to the welfare rolls. 

• Program impacts appeared to decay over time for the AFDC-U 
applicants. 

Both program models produced statistically significant increases in 
employment and earnings during the quarter after application. These 
impacts then declined so that, by the last quarter of follow-up (quarter 
6), there were negligible and not statistically significant earriings 
increases. The deterioration of these short-term gains was primarily due 
to the fact that controls quickly caught up to experimental s. 

Welfare savings lasted longer. Reductions in welfare payments peaked 
in quarter 3 for both groups and, after a moderate decline, stabilized and 
remained statistically significant through the last follow-up quarter. 

• In general, mandating EWEP for AFDC-U f s did not improve 
program outcomes compared to those found for the Job Search 
program. 

EWEP did not have any additional effects on most outcomes measured, 
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although employment was slightly higher (about 2 percentage points) and 
earnings were slightly lower ($168) during the 18-month period. The EWEP 
add-on did cause a statistically significant growth in welfare receipt of 
almost 3 percentage points, but welfare payments also decreased by $60 over 
the full 18 months. There is no explanation for these contradictory 
trends, 

• Examination of impacts on subgroups of AFJC-0 applicants 
reveals larger reductions in welfare payments and greater 
increases in earnings among those with some prior welfare 
dependency as compared to those with no prior dependency. 

The effects of both program models were greater for applicants with a 

history of welfare dependency. The earnings gains were more than five times 

higher and the welfare reductions four times as large. These findings 

suggest that both program treatments were more beneficial for the 

disadvantaged subgroups. 

Findings from the Ben efit-Cost Analysis 

The benefit-cost analysis of the Job Search and Job Search/EWEP 
programs compares their operating and support costs to their effects on 
employment, dependence on welfare and other transfer programs, as well as 
use of alternative services, over a five-year period beginning with the 
random assignment of each applicant. The analysis considers these costs and 
effects from the standpoints of taxpayers, welfare applicants, and society 
as a whole. Because the data cover a follow-up period — on average about 
two years — that is shorter than the five-year time span, the overall 
results reflect a number of key assumptions about projected future program 
effects. 
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• There were consistent large net gain3 to taxpayers for both 
programs and for both the AFDC and AFDC-U applicant groups. 

Both programs produced clear gains to taxpayers. As shown in Table 3, 

taxpayers 1 gains were greater from the Job Search/EWEP approach well 

over $1,000 per experimental for both the A7DC and AFDC-U groups — than 

from Job Search alone. In part this reflects the value of the goods and 

services produced by those who worked in EWEP assignments, which was a 

benefit to taxpayers. About one-fifth of experimental in the Job 

Search/EWEP sequence held these positions for periods of up to 13 weeks, 

and the estimated value of their work was $205 per AFDC experimental and 

$354 per AFDC-U experimental. For the AFDC group, however, the greater 

value to taxpayers of the Job Search/EWEP program over Job Search alone 

also reflects the larger effects of that sequence on employment (and hence 

taxes) and on welfare expenditures, as discussed above. 

• The net budget impact of the programs was positive for all 
experimental groups. Continuing budget savings over the 
entire five-year period easily surpassed short-term costs. 

All net benefits and net costs included in the taxpayer perspective, 

except the value of the EWEP output, directly affect government budgets. 

Thus, the overall net value of the Job Search program to taxpayers — a net 

gain of $452 per AFDC applicant and $1,239 per AFDC-U applicant — was 

approximately the same as its government budget effect. However, work 

experience output is subtracted frum taxpayer results to obtain the net 

program effect on government budgets, as was the case in the Job 

Search/EWEP sequence. This still left a budget gain from the taxpayer 

perspective for both groups: $950 per AFDC experimental and $1,060 per 

AFDC-U experimental. For the AFDC's, increases in taxes (largely because 
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ESTIMATED BENEFITS AND COSTS PER EXPERIMENTAL OVER FIVE "YEARS 







Job 8aerch - 


BfEP 


Job Search 




Accounting Perepectlve 


Accounting Perepectlve 


Component of Analyels 


8oc1al 


Applicant 


Taxpeyar 


8oc1el 


Applicant 


Taxpaye* 


Bonef Ite 






AFDC SAMPLE 






Value of BfEP Output 


$205 


$0 


$805 


-$3 


$0 


-$3 


Increased Earnings 


esse 


8*38 


0 


1536 


1536 


0 


Increased Tex Poynante 


0 


-371 


371 


0 


-835 


835 


Reduced AFDC Payments 


0 


-740 


\ 740 


ft 

0 


-453 


453 


Other Reduced Tranef er Psywenta 


0 


-336 


336 


0 


-EBB 




Reduced Trenafar Administrative 














co ax a 


68 


0 


nn 

Be 


K4 

Dl 


0 


E4 


Reduced Uaa of Training Progrms 


53 


-4 


07 


46 


-4 


50 


Co ate 














EPP Operating Coat a 


-516 


0 


-516 


-535 


n 
D 


— 030 


Eacr upa rating ccate 


-BS 


0 


— OS 


4 

1 


n 
0 


4 

1 


Allaaencee end Support 8erv1cea 


0 


31 


— 3l 


n 
U 


86 


-86 


Client Out-of-Pocket Expanaea 


-15 


-15 


n 
u 




0 


0 


Net Preaent Value 


$1952 


$787 


$1155 


$1096 


So«*4 




Benef Ita 






AFOC-U 


SAMPLE 






Value of WEP Output 


$354 


$0 


$354 


$5 


$0 


$5 


Increaead Earnings 


151 


151 


0' 


433 


433 


0 


Increased Tex Payments 


0 


-48 


48' 


0 


-89 


89 


Reduced AFDC Poynante 


0 


-4351 


1351 


tr 


-1385 


1385 


uxnar hsouoso irenerer rayejon*B 


0 


-881 


881 


0 


-846 


846 


Reduced Trenafar Adnlnlatretlve 














Coats 


116 


0 


116 


117 


0 


117 


Reduced Uaa of Training Programs 


55 


a 


55 


44 


B 


44 


Co eta 














EPP Operating Coata 


-585 


0 


-565 


-655 


0 


-555 


BfEP Operetlng Coata 


-106 


0 


-106 


-1 


0 


-1 


Allovanoea end Bupport Scrvloee 


3 


oS 


-36 


r 


"J1 


-31 


Client Out-of-Pocket Expenaae 


-16 


-16 


0 


0 


0 


0 


Net Pi eeent Value 


-$89 


-$1443 


$1414 


$43 


-$1196 


$1839 



SOURCE i Table a 5.8 and 5.9, 

NOTES t Benefits end costs refUct aetlsistsd experlsientel-control differences. See Chapter 5 for 
date oouroee ond aetlaotlon proceduree. Becauee of rounding, dstall siey not sua to totals. 



Eatlsisted value of oosiponant leas than $0.50. 



ERLC 



of the gains in earnings) and reductions in APDC welfare and other transfer 

payments were together greater than the costs of the programs. For 

AFDC-U f s, reductions in transfer payments were the driving factor. 

For the AFDC assistance group, the positive estimated budget impacts 

over five years differed from the short-term net budgetary costs reported 

in the interim report. For the AFDC-U 1 s, the *nail short-term budgetary 

gain became much more substantial over the longer period. Indeed, it is 

important to recognize that the budgetary return on investments such as EPP 

Jotf Search and EWEP work experience occurs well after the initial 

expenditures are made. This is because program participation precedes the 

programs 1 employment impacts — impacts that precede the effects of 

increased taxes and lower welfare receipt. Moreover, because of MediCal 

regulations, the programs' effect on MediCal benefits occurs only after 

individuals have been off the welfare rolls for several months. 

• The positive budgetary impact of these programs was felt at 
all levels of government — federal, state and local. 

Most of the budget impact was felt at the federal and state levels of 

government. The bulk of the program operating costs was borne by the 

federal government, but it also experienced the greatest benefits. Reduced 

AFDC and MediCal payments, increased taxes and other budget gains resulted 

in a positive overall federal budget effect of between $430 and $636 per 

experimental, depending on the program and assistance category examined. 

The state shouldered a smaller part of the programs 1 coats but gained 

substantially as a result of AFDC and MediCal reductions, as well as tax 

increases. The overall budget gain to the state was between $3 and $553. 

Interestingly, the programs had relatively little budget impact at 
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the local level, the level at which the programs were operated. There, the 
U3t gains were only between $21 and $71. However, San Diego 1 s county and 
city government agencies were the primary beneficiaries of the labor 
services provided by EWEP participants, although these services did not 
affect their budgets. 

It should be noted that these budgetary effects reflect the funding 
arrangements and matching requirements present at the time of the demonstra- 
tion. Changes in these budgetary parameters obviously would change the 
budget impacts. For example, had less federal funding been available to 
pay for program operating oosts, and had California paid these costs out of 
state funds, the net effect on the state budget would have been negative. 
This suggests a rationale for federal involvement in the funding of social 
programs like these with broad budgetary implications. 

• The net financial effect of the programs on welfare applicants 
was not as consistent as the effect on taxpayers. For the 
AFDC applicants assigned to Job Search/EWEP, there were clear 
gains, while the gains to those in Job Search varied by the 
time of welfare application. For AFDC-U's, there were large 
overall losses. 

In contrast to the consistently positive benefit-cost findings from 
the perspective of taxpayers, some welfare applicants gained financially as 
a result of the programs, while others lost income. AFDC applicants 
assigned to Job Search/EWEP experienced large net gains; higher employment 
generated increases in earnings and fringe benefits of $2,232, reflecting 
both the period directly measured and projected future earnings. This gain 
was reduced by an increase in the taxes they paid (a gain to tae 
taxpayers). Partly because of the program's effect on employment, the 
applicants' dependence on transfer programs was reduced. Average welfare 
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payments to applicants in Job Search/EWEP decreased oy $740 and MediCal and 

Food Stamp benefits also declined. Still, there was an overall net 

increase in income of about $800 per AFDC applicant in Job Search/EWEP. 

Early applicants assigned to Job Search only ~ those who applied for 

welfare before April 1983 ~ had much the same experience as their 

counterparts assigned to Job Search/EWEP. However, later applicants in Job 

Search experienced a loss in income rather than a gain. This resulted 

largely from the poor employment performance of these applicants, as 

described in the impact analysis findings. Overall, therefore, applicants 

in Job Search had a lower earnings gain ($1,536) and a smaller net increase 

in income ($644) than those in Job Search/EWEP. 

AFDC-0 applicants were net losers, largely as a result of the 

programs 1 effects in reducing the benefits they received from MediCal and 

welfare. The net income shift was especially large for the Job Search/EWEP 

group. On average, these applicants lost over $1,300 in AFDC payments and 

over $200 in other transfers, while experiencing only a $151 gain in 

earnings and fringe benefits. As a result, AFDC-U applicants lost an 

estimated $1,443 over the five years covered by the analysis. The AFDC-U 

applicants in Job Search had a relatively better employment experience. 

That program generated a gain of $433 in earnings and fringe benefits, and 

resulted in a smaller overall income loss. 

• The social benefits of serving AFDC experimental s were substan- 
tial and exceeded social costs for both programs. For the 
AFDC-0 experimental s, benefits were approximately offset by 
costs. 

By combining the effects on taxpayers and on welfare applicants, the 
overall impact of the programs on society as a whole can be identified. As 
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shown in Table 3 f both programs for the APDC group produced a net social 

gain. Indeed, from the perspective of society, both programs for the AFDC 

group had more than paid for themselves before the end of the two-year 

observation period. When the projected benefits beyond this period are 

taken into account — to cover a five-year period in all — the total net 

present value to society of the Job Search and Job Search/ EWEP programs 

was $1,096 and $1,952 per experimental, respectively. 

The overall results for the APDC-D group were less positive than for 

the AFDC group. For the AFDC-U applicants, Job Search yielded a social net 

present value of only $2»3, while Job Search/EWEP produced a net social loss 

of $29. For this group, the long-term benefits of the programs — those 

occurring after the two years of observation — were estimated as close to 

zero. Thus, the overall results for the AFDC-U 1 s differ somewhat from the 

interim findings, which indicated that short-term social benefits exceeded 

costs for the Job Search/EWEP program but not for the Job Search program. 

Using a five-year time horizon, both programs more or less came out even. 

• The addition of mandatory work experience produced large net 
taxpayer and social gains for the AFDC group, but not for the 
AFDC-U group. 

The combination of Job Search and EWEP produced almost $900 more in 
social value for the AFDC applicants than Job Search alone. However, this 
was almost entirely due to the relatively poor performance of applicants 
assigned to the Job Search program after March 1983; the social value of 
this program was Just as high as the Job Search/EWEP program for early 
applicants. This suggests some inconsistency in EWEP f s effectiveness, 
which, as previously noted, may be associated with varying economic 
conditions, differing applicant characteristics, or other factors, 
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including random chance. The addition of EWEP for the AFDC-U group 
produced no net social or taxpayer gain. 

• Job Search/EWEP, and to a lesser extent Job Search, - ere much 
more cost-effective for AFDC applicants with no recent work 
experience. 

The social net present value of providing Job Search/EWEP to AFDC 
replicants who had not worked in the past year was three times the value of 
that program run for those who had worked. The costs of the program for 
those who had not worked were slightly higher, but the net benefits were 
dramatically higher. Similarly, Job Search alone was more effective for 
this group. 

• Net operating costs were modest, with the average cost of 
operating Job search considerably more than that of operating 
the EWEP component. 

The net operating co3ts of the Job Search and Job Search/EWEP programs 
that is, costs in excess of program expenditures on control group 
members — were quite low. The cost of the Job Search program including 
the net costs of registration and assessment (over and above the costs for 
controls) — came to between $516 and $585 per experimental (including both 
participants and nonparticipants) , while the additional costs of EWEP were 
$89 and $106 per AFDC and AFDC-U experimental, respectively. These 
estimates include the costs of operating the Job search workshops and EWEP, 
the costs of sanctioning applicants who did not comply with program 
requirements, ac3. the costs of recordkeeping and administration, including 
administration at the state level. There were, in addition, costs of 
between $26 and $36 pp experimental associated with allowances and support 
serices provided artioipants. 

It is important to recognize that these benefit-cost results are 
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subject to several sources of uncertainty in addition to those already 
discussed. First, it has been assumed that the higher employment rates of 
experimental have not resulted in the displacement of other workers. 
Second, several intangible benefits and costs have not been measured, auch 
as the benefits associated with society's preference for work over welfare. 
In addition, the social benefits or costs of welfare mothers spending more 
time working and less time caring for their children cannot be assigned 
dollar values. These limitations should be kept in mind in interpreting 
the results of this analysis. 
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CHAPTER 1 
INTRODUCTION 



Since 1982, the County of San Diego in California has been operating a 
demonstration to test the effectiveness of two program strategies designed 
to increase the employment of welfare recipients and to reduce the oosts of 
public assistance. One approach, the Employment Preparation Program (EPP), 
emphasizes Job search, primarily conducted in workshops where welfare appli- 
cants are taught how to locate and obtain unsubsidized Jobs. The second 
strategy combines EPP Job Search with the Experimental Work Experience 
Program (EHEP), an approach that requires welfare recipients to work in 
public or nonprofit agencies in exchange for their welfare benefits. 

Participation in both program models is mandatory and sequential: 
that is, Job search is required of all new WIN-mandatory applicants for Aid 
to Families with Dependent Children ~ both single (AFDC) and two-parent 
(AFDC-U) households. 1 Individuals in the Job Search/EWEP model who fail to 
find regular Jobs through the workshops are then assigned to EWEP work 
experience. 

The Employment Preparation Program is a major California initiative. 
After the legislature authorized the program in 1980, California imple- 
mented it on a demonstration basis in three counties: Lake, San Mateo and 
Ventura. in 1982, the state expanded EPP under federal demonstration 
authority, and in the same year, passed legislation authorizing EWEP in San 
Diego. The Manpower Demonstration Research Corporation (MDRC) was 

selected to evaluate both EPP Job Search and EWEP in San Diego. 3 
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This report is the last of three on the multi-year San Diego evalu- 
ation and presents the final impact and the full benefit-cost study. The 
two previous reports, published in 1984 and 1985, examined the feasibility 
of the models and the levels of participation; the necond also presented 
the programs' impacts and the benefits and costs through December 1 983. 21 
While this report draws some material from the second report, primarily to 
summarize the background and context of the two San Diego programs, it 
primarily updates the earlier impact findings using data from a longer 
follow-up of the full sample and extends the benefit-cost analysis beyond 
the available follow-up period for five years in all. Other important 
issues are whether adding EWEP after the workshops produced incremental 
effects on employment and welfare behavior and which subgroups benefited 
most from the program models. Impacts for the primarily female AFDC assist- 
ance category are analyzed separately from those for the mostly male AFDC-0 
group. 

This chapter summarizes the salient features of the Job Search and the 
Job Search/EWEP variations in San Diego, the MDRC evaluation design, and 
the findings on program implementation, as discussed in previous reports. 

A. Program Model 

Historically, welfare policy has been a main issue in California 
politics. 5 Prior to the 1980s, California made several attempts to respond 
to the problem of growing welfare caseloads, reflecting the public's 
interest in requiring useful work from welfare recipients as a condition of 
welfare receipt. Between 1972 and 1 975, a limited work experience program 
had required that "employable" recipients work in non-salaried jobs in 
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return for their grants. The program, however, was controversial and had 
serious implementation problems; many counties either refused to operate it 
or delayed its implementation, primarily because there were no additional 
administrative funds, many legal challenges, and opposition from welfare 
rights groups and oommunity organizations. Overall, in 1974, less than 3 
peroent of the potentially eligible registrants had participated. 

After the eleotion in 1974 and a subsequent change in administration, 
the legislature repealed the state's authority to test community work 
experience for the welfare population and substituted a new set of employ- 
ment and training services. The focus was job clubs, with which both the 
state and the national Work Incentive (WIN) Program lad had favorable 
experiences. Consequently, the Employment Development Department (EDD) 
and the Department of Social Services (DSS) developed a demonstration 
project called the Job Search Assistance Project (JSAP), which was to offer 
AFDC applicants both group and individual job search and some skills 
training. The first JSAP project was implemented in 1979, closely followed 
by a number of other similar projects including the federally-funded 
Employment Opportunity Pilot Project (EOPP), a test of job search followed 
by subsidized employment. 

Toward the end of 1979, EDD was searching for a way to expand JSAP, 
and the California legislature again concentrated on welfare reform, 
initially turning to work experience. From these simultaneous interests 
came a bill seeking to categorize "employable" and "nonem ploy able" welfare 
recipients and calling for early intervention to prevent employable persons 
from becoming long-term recipients. The primary service was to be group 
job search, as used in JSAP, with the promise of training for those who did 
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not find work through Job search. 6 By the summer of 1980, JSAP had evolved 
into EPP which, as no*ed earlier, was approved by the California legisla- 
ture that year. 

The state legislature continued to reject statewide workfare 
proposals, emphasizing instead Job search assistance, despite the passage 
of the 1981 Omnibus Budget Reconciliation Act (OBRA), which authorized 
states to run Community Work Experience Programs (or CWEP) for welfare 
recipients for the first time. Interest in work programs did not decline, 
however, and a different political context in the County of San Diego 
allowed a policy compromise: a test of EPP Job search followed by community 
work experience for those who failed to find Jobs through the group Job 
search workshops. 

The county's interest in work programs was based on several concerns. 
First, the AFDC-U and particularly the AFDC caseload had grown steadily 
over the last decade. The AFDC level in fiscal year 1981, for example, was 
nearly double that of the caseload in fiscal year 1971 (about 30,500 
individuals versus 18,500), while the much smaller AFDC-U caseload was at 
5,900 in 1981 compared to 2,400 in 1971. 7 The AFDC caseload had, however, 
stabilized at a high level in the 1980s. Second, the county had already 
experimented with workfare programs for recipients of other income transfer 
programs: General Relief, since the 1930s, and Food Stamps, beginning in 
1979. Third, San Diego was more conservative politically than other areas 
of the state and also considered itself a lesder on issues of welfare 
reform. In the 1980 election, the electorate had reacted positively to a 
referendum asking whether the county should "where legally possible, deny 
welfare benefits to able-bodied recipients who refuse to perform work in 
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return for welfare benefits." In this context, further investigation of 
community work experience seemed appropriate. 

In translating general public support into an operational work 
program, oounty offioials speoified two main objectives: developing the 
work skills of welfare recipients, and reducing the rolls and the costs of 
welfare. The San Diego program was thus structured as a sequential program 
of four stages. Following job placement assistance provided on the day of 
welfare application, people were referred to a three-week group job search 
program, in whioh they participated in workshops designed to build self- 
confidence and job-seeking skills. In the two weeks of self-directed job 
search that followed a week of orientation, applicants used phone banks to 
call prospective employers. Individuals who had not found employment by 
the end of the workshop were then referred to EWEP, or community work 
experience, in which they were required to hold positions in public or 
nonprofit agencies for up to 13 weeks. The maximum number of work hours 
could not exceed the amount of the grant divided by the federal minimum 
wage, with the further restriction that participants be allowed one day a 
week for individual 'job search. 

The San Diego initiatives first gave priority to new WIN-mandatory 
applicants for the AFDC-D program, who are primarily male. The target popu- 
lation was later expanded to include applicants for AFDC, who are almost 
all female. 

To fund the project, the county became part of the state 1 s EPP demon- 
stration of Job search and obtained separate legislative authority to 
operate a oommunity work experience program through a federal demonstration 
project. Administrative and operational responsibility for the EPP Job 
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search program was held by EDD staff, while County DSS staff administered 
and operated EKE P. With a clear mandate to curb welfare caseloads and 
cowts by improving the unsubsidized employment of welfare recipients, the 
project began operations in August of 1982, with the workshops beginning 
immediately and EWEP operations starting up in November 1982. 

The EPP Job Search/EWEP model has been continuing to evolve. On July 
1i 1985, two local EPP offices built onto the demonstration evaluated in 
this report by putting into operation a program called the Saturation Work 
Initiative Model (SWIM). Operated as part of a federal demonstration 
project, SWIM involves recipients as well as applicants in an employment 
program with an ongoing participation requirement. Elsewhere in San Diego 
County, the EPP/EWEP model was maintained and was not associated with this 
federal demonstration. In September 1985, California passed legislation 
setting up the Greater Avenues for Independence, or GAIN Program, a 
comprehensive employment initiative for the welfare population that in its 
design drew in part on the San Diego experience. The legislation calls for 
GAIN to be fully implemented in all counties of California over the 
following five years. 

B. Evaluatio n Design 

MDRC's evaluation of San Diego's initiative was designed to answer 
questions raised by the state. It also reflected MDRC's interest in 
studying new welfare employment programs, particularly those with 
participation and work requirements, as part of its research in the 
Demonstration of State Work/Welfare Initiatives. This multi-state study 
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seeks to assess the relative effectiveness of programs implemented across 
the country to improve the employment of welfare recipients and decrease 
welfare caseloads and costs. 8 The State of California provided funds to 
evaluate the EPP Job Search program, and MDRC drew on demonstration funds 
provided by The Ford Foundation to evaluate EWEP. Supplementary funding 
also came from the Congressional Research Service of the Library of 
Congress. 

The research design includes three types of studies: process, impact 
and benefit-cost. Table 1.1 summarizes the questions, the methodology and 
data sources of each analysis. 

1. The Process Analysis 

The process analysis has two main parts. One describes the content 
and operations of the programs, also documenting and explaining the 
patterns of participation for the eligible caseload and different sub- 
groups. An important issue was whether the mandatory EPP program could 
achieve rates of participation similar to those found in prior more volun- 
tary Job search programs. In examining EWEP participation, a main question 
was whether the experience was similar to previous CWEP programs, in which 
relatively few among a large eligible population ever received a Job 
assignment. The behavior of nonpar tici pants was also taken into account in 
Judging program accomplishments. 

The second part of the process analysis examines the EWEP worksite 
experience through interviews with both participants and their supervisors. 
The issues studied include the types and quality of the Jobs, the extent to 
which the skills and work habits of participants improved, participant 
attitudes about the fairness of the work-f or-benefits approach, and other 
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TABLE 1.1 
SAN DIEGO 

DESIGN FDR THE EVALUATION OF THE SAN DIEGO DEMONSTRATION 



Raeaarch Cooponent And Queatlona 


Methodology 


Data Sourcoo 


Ra porta 


IMPACT ANALYSIS 

Dom Job March or Job aaaroh/EVEP In 
Son O1O0O rooult In on Inoreeaa In 
aaployaant ond eernlnga or o reduc- 
tion In vol fore dependency ond 
bono n to? 

Do lapocto vory for AfDC ond AFDD-U 
opplloonto or for othor oubgroupo? 


Campari eon of tho employment and 
■olforo outoomoo ovor tloo for AFDC 
■nd AFDO-U opplloonto randomly 
■ooignod to ono of tho too exp. ri- 
ven to I prograaa or to a control 
group ollglblo for rogulor WIN 
oorvlooo 


Uniform oliont ohoroetorlotlco 

oolloctod ot eel fere application 
AFDC peyaant and Unemployment 

Inauranca aarnlnga fliaa for up 

to £4 aontho af tar rondoa 

eeeignment 
Survoyo of o oaoplo of oxperioontelo 

and oontrolo 6 men tha oftor 

rondoa eeeignment 
Program oomlniotrotlvo raeorda 


PI rat (Liaitad) 

Second/Third 


PROCESS ANALYSIS 

Parttcloont Flo. QtUdY 

What 1o tho pottorn of program partlcl- 

potion ond ehot foctoro oxploln 

obaarvad difference? 

Io participation mandatory ond do 
participation rotoo vory for 
dlfforont oubgroupo of tho AFDC ond 
AFDC-U population? 

Whet 1a tha oontant and adelnlatratlva 
atructura of tha eeaonotrotion 
prograaa? 

Mork.1t. Studv 

Whet 1o tho quality of tho BtfEP 

worksite*? 
Do thay davalop eaployabl 11 ty or 

provldo ooolol benefit.? 


Anolyolo of tho pottorn of program 
rog1otrot1on f eeeignment, ond 

participation 

Study of tho Intoroction botaioon 
participation pattorno and program 
deolgn, Inotitutlonol orrongemantOf 
eomlnlotrotlvo practice, and 
ovarall conditiono 

Anolyolo of tho ohoroctorlotica of 
mrogrem merkattaat do 'thay develop • 
Job akllla? do thay provldo uaaful 
goodo ond aarvioao? do thay 
dlaplaoa ragular vorkero? do thoy 
provldo poyohological bonarita? 


Program oomlniotrotlvo rocordo, 
Inoludlng etetue, outcome, md 
participation doto obtoined 
through tho EPP Inforootion 8yotoa 
(EPPI8) and logo of E*EP activity 

Syatomotlo oboorvotioni com filo 
otudioo, Intorvlemo with progre* 
ataff and partlclponta 

Forty-nine ourvoya conducted with o 
• random oemplo of parti ct- pan ta 

at BfEP morkelteo in San Oiogo 

ond tholr ouporvlooro 


F1 rat/Sacond 
Fi rat/Sacond 


BENEFIT-COST ANALYSIS 

Dooo tho Job March or Job eoorch/BtfEP 
progran In Son Diego lood to an 
Inorooaa or docrooaa in not cooto 
(ovor ond obovo WIN cooto in oorvlng 
oontrolo)? 

Do not program banaflto oxoood or foil 
below program ooato? 


EatiMtlcn of tha not op. rating coata 
(Including aomlnlotrotlon ooata ond 
peyaenta to Inotltutlono ond to 
portlclponto for mork-ralettd tx- 
ponaoo) for experimental compered 
to tho control group 

Eot1 motion of tha not voluo of tho 
ototo Inltlatlva by comparing 
additional coata and bonoflta 


8tata and loci expenditure dotoi 
doto on oupport eervlce peyoante, 
and atudiaa of .toff tiao 
ol location 

Coot data, program admlnl atr'tlve 
rocordo, Impact aotlaotoo, and 
valua of output ootlootoo from 
tho BrfEPeork.1t. atudy 


Sooond/Thi rd 



NOTES! *Tha firat report refere to tho Preliminary Findings of %hm Han, Dl^oo Dimonitratlon publiahed In February 1884; the eocond 
report refere to tho Flndlnoa, froa tha Ban Diana Job B..nch and Work Expo rl one Da.onitrati on publiahed in Kerch 1935 j tha third report 
refere to thlo report. 

b 

Theee doto ore included in tho EPP Information Syotoa. 




questions pertinent to a mandatory work program for a welfare population. 
2. The Tmnafif. Sfcuflg 

The full impact study addresses a number of questions about the effec- 
tiveness of the San Diego initiative including: Will either or both models 
have Impaots on participants' employment and earnings, reoeipt of welfare 
and the size tsT the benefit oheck? Will the impacts vary across different 
subgroups: the AFDC versus the AFDC-0 assistance category? The early 
program enrollees versus the later ones? People with recent employment 
experience versus those with a less current work history? 

These and other issues are investigated by means of an experimental 
design in whioh random assignment determines the study groups. In San 
Diego, a broadly defined segment of APDC and AFDC-U applicants were 
randomly assigned to one of several experimental groups that took part in 
the programs or to a control group, eligible for services from a WIN 
Program in whioh activities had been severely curtailed because of national 
funding outs. Since random assignment should ensure that sample members 
are similar in all characteristics except the services they reoeive, any 
statistically significant differences in behavior should be due only to the 
different program treatments. (See Chapter 2.) The control group demon- 
strates what would have happened in the absence of the special programs 
evaluated in this report. 

The two main experimental groups allowed separate assessment of the 
program models. To investigate the effectiveness of a mandatory Job soarch 
requirement, members of one experimental group were required to participate 
only in Job search. Members of the other experimental group, although also 
required to participate in the workshops, were assigned to EWEP positions 
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if they were still unemployed after job search. Thus, this sequence tested 
a program model oombining mandatory job search with short-term community 
work experience. Program impacts were estimated for both models by compar- 
ing welfare and employment outcomes of the experimental s and controls. 

The research sample for this study was large. Between October 1982 
and August 1983, 9 a total of 6,997 AFDC and AFDC-U applicants were randomly 
assigned to the experimental and oontrol groups: 1,878 to the Job Search 
only group, 3,235 to the Job Search/EHEP group 10 and 1,884 to the control 
group. (In addition, 1,639 were assigned to an extra experimental group, 
one not part of the research sample because of its low priority for 
services.) The full sample and subgroups were tracked for between 15 and 
18 months, while early sample members were followed for up to 2*! months to 
identify longer-term effects. 

3* The Benefit-Cost Analysis 

The third part of the research design, a benefit-cost analysis, 
compares the net costs of operating EPP and EWEP (i.e, the costs over and 
above those of the WIN Program services offered to the control group) to 
the net benefits — ones that result primarily from any increases in 
employment, reductions in welfare payments and the estimated value of the 
work performed by EWEP participants. Three perspectives — that of society, 
the welfare applicants and "taxpayers" (and also the narrower goverment 
budget view) — are used to examine questions of cost-effectiveness. 

C. Lessons from the Previous Reports 
1. Participation and Fea sibility 

As noted previously, prior reports focused on the operational feasi- 
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bility and the implementation experience of the two models through tne 
spring of 1984. Since enrollment into the demonstration ended in August 
1983 and the treatments were relatively short, most of the research sample 
received services during this period. 

The second report ooncluded that the two programs operated as planned, 
and that San Diego did enforce a Job search participation and EWEP work 
requirement. The close cooperation of competent staffs in the two agencies 
responsible for the programs, as well as strong public and political 
support, helped make this possible. 

Program operators had anticipated serving about half of all new appli- 
cants, and participation rates were close to this goal: 48 percent of the 
WIN-mandatory experimental applicants (or 57 percent of the EPP regis- 
trants) participated in some program aotivity, while less than 5 percent of 
the control group applicants took part in WIN services. Most of the 
activity was concentrated in the workshops, in which 55 percent of the EPP 
registrants participated. 

Of those randomly assigned to the Job Search-EWEP sequence, almost all 
of the people eligible for EWEP (i.e., those approved for welfare who had 
not found Jobs during the workshops) were referred, and the majority of 
those referred (61 percent) did work in a mandatory EWEP assignment. As a 
proportion of those initially registered for EPP Job Search, about 15 
percent worked in an EWEP position. In general, this rate is comparable to 
or exceeds the levels previously found in special demonstrations of 
community work experience for this population. 

Somewhat more of the AFDC-O's (60 percent) than AFDC's (55 percent) 
participated in the two program models, although there were no strong or 
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consistent differences between the two groups. Additionally, the interim 
findings showed that the possibility of an EWEP assignment did not cause 
people to withdraw from the program or affect Job search participation in 
other ways, probably because program staff did not discuss the pending work 
requirement until near the end of the workshop. 

These participation rates, however, understate operational achieve- 
ments. The ultimate goal of the San Diego program was to reduce the size 
of the welfare rolls, not to maximize program participation. Thus, any 
conclusion about operational success should consider not only how many 
participated in the program, but also how many left the welfare rolls 
before participating. Individuals may have left welfare for many reasons 
not associated with the program requirements as well as for related 
reasons; they may have found Jobs on their own, or remarried; their family 
income may have changed. Those who remained on welfare could either have 
been sanctioned or legitimately excused from participation for such reasons 
as the birth of a child; some may simply have been lost in the administra- 
tion of a large program. 

A careful examination of the status of participants and nonpartici- 
pants nine months after welfare application suggests that in fact few 
registrants remained on welfare without having fulfilled program require- 
ments. Of those eligible, only 9 percent of the AFDC and 6 percent of the 
AFDC-U groups were still registered with the program but were not served by 
staff at the nine-month mark, and many of these people had been officially 
deferred or exempted from the program requirements by San Diego staff. 

Further evidence that San Diego attempted to run a large-scale program 
involving most of the eligible employable population is seen in the broad 



-12- 



58 



eligibility criteria and the program's philosophy that the labor market ~ 
not the Judgnent of staff ~ is the most appropriate way to screen 
job-ready workers. Thus, the program streamlined the WIN appraisal process 
and required that most eligible applicants register for Job search. While 
■any people never showed up initially for the workshop, staff were notably 
persistent in monitoring and following through with those assigned. In a 
random subsample of registrants going through the Job Search/EWEP sequence, 
three-quarters we Identified at some point as being noncompliant with 
program requirements. However, most problems were resolved without 
imposing a sanction. 

The prior reports also concluded that a large number of applicants 
received instruction in Job search skills. Despite the mandatory nature of 
the program and some initial resistance, the registrants soon became caught 
up in group Job search activities, which in past Job search programs had 
been voluntary; less than one-fifth ever dropped out of these workshops. 
In a survey of a subsample of applicants, the majority of registrants who 
were aware of the Job search requirement agreed it was "fair" and those who 
participated found that the workshops were helpful in building 
,'ielf-confidence and conveying interviewing skills. 

San Diego also operational ized the mandatory work program without 
major difficulties. Very few of the implementation delays or obstacles 
that arose in earlier CWEP demonstrations were repeated in San Diego. 
Building on their experience in operating work programs for other income 
transfer recipients, staff readily developed a sufficient number of 
entry-level positions which — while relatively low^skilled Jobs — were 
nevertheless found necessary to the day-to-day business of the sponsoring 
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organizations. 

These Jobs, however, did not appear to improve the skills of partici- 
pants. A survey of a snail random sample of participants and their 
supervisors found that supervisors Judged that all but a very few EWEP 
participants bad adequate work habits and general Job skills when they 
began their Jobs. EWEP nevertheless may have helped participants to 
reinforce these habits or skills. 

The great majority of participants also expressed satisfaction with 
their EWEP positions, although opinions were mixed about whether this work 
was "the price you have to pay" to reoeive welfare. When participants were 
asked to compare the amount of their welfare grant to the value of the work 
they performed, half responded that the work sponsor got "the better end of 
the deal." However, most participants (84 percent) indicated that the 
requirement to work for their benefits was a fair one. Findings from a 
separate, larger-scale survey of both participants and nonparticipants 
found somewhat less support for this sentiment among AFDC's than AFDC-D's. 
2. Impact and Benefit-C ost Analysis 

iBPflot Findings. The second report, using data for the full 
sample over a six-month period, found that both the Job Search and Job 
Search/EWEP programs had substantial and statistically significant impacts 
on the proportion of AFDC applicants employed and the amount that they 
earned. However, welfare savings were modest and statistically significant 
primarily for the Job Search/EWEP group. Longer follow-up, of roughly a 
year for an early sample, did not change these patterns. 

In contrast, neither Job Search nor the Job Search/EWEP sequence had a 
sustained impact on the AFDC-U employment rate or earnings. However, both 
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programs produced statistically significant reductions in welfare payments 
in the short as well as the longer follow-up period, particularly for the 
Job Search/EWEP group. 

The second report did not find that EWEP produced substantial and 
statistically significant additional impacts over the Job search workshops 
for either assistance category, although results were inconclusive; many 
Job Search/EWEP experimental s were still working at the end of the short 
follow-up period. A second important but preliminary finding suggested 
that the EWEP work requirement had not caused a change in workshop 
behavior. 

Benefit- Cogt Resylts. In the short-term analysis presented in 
the second report, only benefits and costs that accrued through December 
1983 were considered, for an average follow-up period of nine months. This 
meant that most of the program costs, but only part of the program bene- 
fits, could be measured during this time-frame. Social benefits were 
substantial and exceeded costs for both assistance categories in both 
programs, except for the AFDC-U's in the Job Search only model. Both 
programs were also effective from the AFDC applicant perspective, producing 
net benefits of over $300 per experimental group member. in contrast, 
AFDC-U applicants were net losers in the short run, largely because the 
programs had reduced their transfer payments — AFDC welfare, Unemployment 
Insurance compensation, Food Stamps and MediCal — without increasing their 
earnings. Taxpayers experienced a corresponding net gain. 

The Job Search/EWEP sequence had a higher overall net value than the 
Job Search only program primarily because of the value of the goods and 
services produced by individuals who worked in the EWEP positions. 
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D. The Curre nt Report 

As this chapter suggests, the evaluation of San Diego's two models 
seeks to provide answers to a broad range of questions about the feasi- 
bility, impact, cost-effectiveness and targeting of mandatory Job search 
and work experience programs. Using longer follow-up data than the earlier 
reports, this study presents the final conclusions on program impacts and 
cost-effectiveness of the San Diego programs, issues that remained unre- 
solved in prior studies of both Job search and work experience. Five 
quarters of follow-up data on employment and earnings and six quarters of 
data on welfare and 01 benefits are used to present impacts for the full 
research sample. An additional six months of follow-up is available for an 
early sample of applicants for whom longer-term impacts were presented in 
the second report. 

Throughout this report, AFDC and AFDC-D assistance categories are 
analyzed separately, as are certain other critical subgroups of the main 
sample. The analysis of benefits and costs also draws on data for the full 
sample and extends benefits beyond the observation period so that a more 
complete picture of cost-effectiveness is presented. However, because this 
report builds on the findings of the two previous reports, less attention 
is paid to the process research. More detailed information on these 
findings can be found in the second report, particularly Chapters 3 and 4. 

Chapter 2 of this report discusses in greater detail the research 
design, the samples and data sources. Chapter 3 presents the employment 
and welfare impacts produced by both program models for the AFDC assist- 
ance category, as well as an assessment of the EWEP add-on effects and the 
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applicant subgroups for whom the program worked best. Similar information 
is oovered in Chapter 4 for the AFDC-O's. Chapter 5 addresses the benefit- 
oost findings over a five-year time span. 
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CHAPTER 2 
THE RESEARCH nRRTP.W 

This chapter presents the research design and analytical techniques 
used in the process, impact, and, to a lesser escent, the benefit-cost 
studies. It then describes the characteristics of the research sample and 
discusses the data sources used in the three analyses. Of particular impor- 
tance is the use of administrative records to measure key outcomes, as 
described in the last section. Chapter 5 provides a more detailed discus- 
sion of the methodology and data sources for the benefit-cost analysis. 

A. The Re search D esign 

The San Diego demonstration tests two program variations for WIN- 
mandatory welfare applicants. One starts with a one-day job placement 
effort at the welfare office and is followed by a three-week job search 
workshop (the EPP Program). The second is similar, except that persons 
completing the workshop without finding employment are assigned to 
community work experience (the EWEP Program) for up to 13 weeks. 

As noted in Chapter 1, an experimental design was implemented to 
isolate the impacts of the two variations. Applicants for welfare, either 
AFDC's or AFDC-U's, were screened and then immediately randomly assigned to 
one of several experimental groups that received program services, or to 
the control group, which received only WIN services (thus representing what 
would have happened in the absence of the program). Each group was tracked 
over a period of time to obtain information on employment and earnings; 
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welfare receipt and payments; and Unemployment Insurance benefit receipt 
and payments. 

Employment programs studied by means of an experimental design typic- 
ally carry out random assignment at the point of program registration. In 
San Diego, however, it began at welfare application in order to assess the 
one-day Job placement effort and to look for any voluntary withdrawal cf 
applications (the deterrence effect) due to the pending participation 
requirement. 

Screened applicants were randomly assigned to one of four groups, the 
first three of which formed the main research sample. (See below.) A 
fifth group, discussed later, was not randomly assigned and was thereby 
excluded from the rtw**-'*, although members were technically eligible for 
program services. indicates the service eligibility of each of 

the five following t ifcion groups. 

• Contrvla, ei. .• ie to revive regular WIN services, but not 
the one-day Job pie cement component, Job search workshops or 
EWE P. 

• Job Search only experimental s, eligible to receive all Job 
search services, but not EWEP. 

• Job Search/EWEP experimental s, eligible to receive both Job 
search and EWEP services. 

• Extra experimental s, eligible to receive both Job search and 
EWEP services, as well as any other EPP services. This group, 
however, had a lower service priority than the other 
experimental s. 

• Applicants not randomly assigned although they were eligible 
for services. 

The extra experimental group was created for two reasons. First, the 
applicant population was very large, and sample sizes were more than 
adequate for research purposes. Inclusion of all applicants in the 



TABLE 2.1 



SAN DIEGO 

EPP AND EWEP SERVICE ELIGIBILITY 
FOR THE SAN DIEGO DEMONSTRATION GROUPS 



Demonstration Group 


Primary Types of 


Servl cee Aval I eble 


One-Day 
Job Placement 
Assl stance 


EPP 
Job Search 
Workshop 


Experimental 
Work Experience 
Progrem (EWEP) 


Other * 
Regular WIN/ 
EPP Services 


Control 


No 


No 


No 


Yes 


Job Seerch-EWEP 


Yes 


Yes 


Yes 


* 


Job Search 


Yee 


Yes 


No 


* 


Extre 


Yes 


Yes 


Yes 


Yes 


Non-Random L y Assigned 


Yes 


Yes 


Yes 


Yes 



NOTESs Although members of e demonstration group may be eligible for e 
particular service, they may not necesserlly receive It. 

Other regular WIN/EPP services mey Include Individual job search, 
training, or education. 

'Indicates limited access to other EPP services. 
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research sample would have been both expensive and unnecessary. Second, 
San Diego never intended to serve all of the applicant group, and random 
assignment provided a way to resolve the capacity issue. Although extra 
experimental s were not expected to receive services, over the course of the 
study period many of this group were, in fact, put in program activities. 

Ihe fifth group of applicants not randomly assigned was also technic- 
ally eligible for program services, but these individuals had been Judged 
by staff as so unlikely to participate that they were excluded from the 
research sample (i.e., refugees, employed persons). 

The research design reflected the interest of both the state and the 
county to evaluate the two program models separately. Dsing experimental- 
control group differences, the impact analysis measures six key outcomes: 
percent employed, average earnings, percent receiving AFDC payments, 
average AFDC payments, percent receiving Dnemployment insurance benefits 
and average UI benefit payments. Chapters 3 and 4 will present: 

• A comparison of the outcomes of controls to those of the Job 
Search/EWEP experimental s to show any differences between the 
whole sequence of activities and the regular WIN Program 
services. 

* 

• A comparison of the outcomes of controls with those of the Job 
Search experimental s to show differences between the EPP Job 
Search model and the regular WIN Program services. 

• A comparison of the outcomes of the two experimental groups to 
isolate the impacts of the EWEP component. The only intended 
difference between the two treatments is work experience. 

As shown below, the experimental and control groups produced by random 
assignment were similar in measurable background and demographic character- 
istics. The comparisons should therefore provide unbiased estimates of 
program imp&ets: that is, on average, the estim^s should neither over- 
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state nor understate the true program effects. However, to improve the 
efficiency of the estimates, as well as to account for any small 
differences that could have occurred despite random assignment, the program 
impacts were calculated using multiple regression analyses. 1 The tables in 
this report indicate by asterisks whether the program effects on employ- 
ment, earnings and welfare (or other outcomes) are statistically signifi- 
cant at the 1 , 5 and 1 0 percent level, using two-tailed t-fcests or 
ohi-square tests. 2 These significance levels indicate how small the 
probability is that a given experimental-control difference would have 
occurred in the absence of the program. 
1. Eligibility 

With only a few exce ptions, individual s applying for wel fare and 
determined to be WIN-mandatory3 were eligible to participate. During the 
11-month period of random assignment, 67 percent (6,997 of 10,389) of the 
WIN-mandatory individuals applying for welfare in the county were randomly 
assigned to one of the three main research groups (with an additional 1,637 
designated extra experimental s). 4 Table 2.2 shows the number of applicants 
in the research sample assigned by assistance category and research group 
from October 1982 through August 1983. 5 

Figure 2.1 follows the flow of new applicants into the program and the 
formation of the research sample. As seen in the figure, random assignment 
procedures were incorporated into the regular application process. First, 
welfare eligibility workers determined if applicants were WIN-mandatory and 
then DSS data clerks randomly assigned all who were, except for those who 
fell into one of the following exempt categories: 
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TA8LE 2.2 



SAN 0ZE60 



NUH8ER OF MANDATORY APPLICANTS RANDOMLY ASSIGNED, 
8Y ASSISTANCE CATEGORY AMD RESEARCH GROUP 
(0CT08ER 1882 - AUGUST 1883 SAMPLE) 



Assistance Cats gory and 
Appl 1 catl on Pari od 


Total 


I 

Job 
S n a r c h — 

W 0 M 1 1*11 

EWEP 


I 

Job 
Seerch 


Control 


All Assistance Categories 


i 

f 








October - December 1882 


1883 


865 


558 


u v u 


January - March 1883 


2282 


1008 


640 


633 


April - June 1883 


1486 


744 


370 


3 82 


July - August 1883 


1236 


617 


31 n 


30£ 


Total 


6887 


3235 


1878 


1884 


AFOC 










Uctober - December 1882 


803 


410 


245 


248 


Jenuery - Merch 1883 


1320 


603 


358 


358 


April - June 1883 


723 


357 


178 


188 


July - August 1883 


645 


317 


161 


167 


Totel 


3S81 


1687 


843 


861 


AFOC-U 










October - December 1882 


1080 


455 


313 


312 


January - March 1883 


862 


406 


281 


27C 


April - June 1883 


773 


3 8'7 


182 


184 


July - August 1883 


581 


300 


148 


142 


Total 


3406 


1548 


835 


823 



SOURCES Tabulations from the MORC Client Information Shetts. 




FIGURE 2.1 
SAN 0IE60 RESEARCH DESIGN 
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Extra 





One-Oey Job 
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EPP Regl at rati on 
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1 EWEP 










Other Serv Ice e 



NOTES! Non-rendomLy eeelgned applicants were required to register with EPP end 
were eligible for EPP end EWEP services. 

Job Seerch-EWEP end Job 8*arch Exper lemntel s were eoch limited to 100 
referrele to trelnlng end education sloes during the demonstration. 
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• Non- federal AFDC-0 grantees who were not eligible for WIN 
services. 6 

• Bnployed applicants, either full or part-time. 

• AFDC applicants who had children under the age of six but were 
WIN-mandatory because they were "out of the home for more than 
brief and infrequent periods," usually because they were 
taking educational or training courses. This ruling took 
effect in January 1 983. ' 

• Refugees. &* 

• Monolingual applicants who did not speak English except those 
who spoke only Spanish. (Originally, San Diego planned to 
conduct Spanish-speaking workshops and randomly assigned. 
Spanish- speaking applicants. However, these workshops wer<*i 
never operated on any large soale.) 

The people in the ex* ; >t categories listed above, who ws«e r^t ran- 
domly assi/jned, amounted to 16.9 percent of the WIN-mandatory applicants. 
Beginning in iate January 1983, information became available to determine 
if these individuals had been appropriately excluded from random 
assignment. AFDC-0' s were exempted primarily because they were non-federal 
grantees or employed part-time. AFDC's were excused mostly because they 
were employed part-time or were WIN-mandatory mothers whose cases included 
children younger than six. 

2. Random Assignment 

Random assignment in San Diego began in August 1982 (at program start- 
up) in a two-month pilot phase, and ended a year later in August 1983. 9 
Generally, the procedure went smoothly. The county's DSS data collection 
clerks, located in each of the seven incest maintenance offices, telephoned 
MDRC to obtain special identifying codes, based on a predetermined set of 
oomputer-generated random numbers, that indicate for each applicant either 
experimental or control status. Applicants were further randomly assigned 
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by office and assistance category to ensure equitable distribution among 
the four research groups. MDRC kept lists alphabetically and by Social 
Security number in order to avoid randomly assigning applicants again if 
they re-applied for welfare. 

B. The fiaaflaCflh Sample 

In some experiments the complete sample is selected as the program 
starts, but in San Diego new applicants were continuously enrolled into the 
research sample over the yearlong period. This report focuses on the 6,997 
welfare applicants — 3,591 AFDC's and 3t*»06 AFDC-U's — who were randomly 
assigned to one of the three main research groups. (It should be noted 
that the numbers of AFDC's and AFDC-U's in the research sample are not 
representative of their actual proportions in the San Diego caseload. 
AFDC-U's constituted a smaller proportion of the sample than they did the 
caseload, whioh included AFDC's exempt from participation in WIN.) 
Different lengths of post- application follow-up were available for 
subgroups of applicants, depending on when random assignment occurred. 

1. Sample Characteristics 

Random assignment worked effectively to produce experimental and 
control groups with similar demographic characteristics. The only signi- 
ficant differences in demographic characteristics were slight ones in ethni- 
city and marital status for the AFDC category. (See Appendix Tables A. 1 
and A. 2 for selected characteristics.) Given this overall similarity, most 
statistically significant differences in outcomes among the three groups 
can be considered to have resulted from the program treatments. 

Both the AFDC-0 and AFDC samples appeared to be less disadvantaged 
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than the national welfare population, as indicated by the findings reported 
below on the level of education and previous work experience. 10 Table 2.3 
shows that the San Diego AFDC-U research sample was primarily male, married 
and living with a spouse, and white (53 percent) although another 33 
percent were Hispanic. Three-quarters of the sample had children younger 
than six. The average age was 31 years, and slightly over one-half of the 
sample held either a high school diploma or an equivalency degree. Almost 
60 percent had never been on welfare, and about three-quarters reported 
some earnings during the year before welfare application. 

The AFDC sample was slightly older and primarily female, with a 
smaller proportion Hispanic; 57 percent were white, with the rest almost 
equally black and Hispanic. The sample's educational background, however, 
was similar to that of the AFDC-U category; as noted above, both samples 
had considerably higher levels than might be expected of a welfare popula- 
tion. The majority of the AFDC's were divorced, widowed or married but not 
living with their spouses. Less than one-quarter (as opposed to over 
three-quarters of the AFDC-U sample) had children younger than six. 

AFDC members had had less prior employment than the AFDC-U' s; about 
one-half (in contrast to almost three-quarters of the AFDC-U's) had held 
Jobs during the year before application. Not unexpectedly, AFDC's also 
exhibited greater welfare dependency; one-quarter had received welfare 
payments for more than two years. 

2. Welfare Rules of the Two lasi sta nce Programs 

Besides indicating that random assignment effectively generated 
similar experimental and control groups, the characteristics presented 
above point to real differences between the two assistance categories. 
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TABLE 2.3 



SAN OIE60 

SELECTEO CHARACTERISTICS OF THE RESEARCH SAMPLE 
AT THE TIME OF WELFARE APPLICATION, 9Y ASSISTANCE CATEGORY 



(OCTOBER 1992 


- AUGUST 1993 SAMPLE] 






I 


r 


Characterl st 1 c 


AFDC 


AFOC-U 


EPP Office IX) 






San O1ego Meat 


19.5 


14. 9*** 


Oceaiid da 


8.5 


7.6 


Sin 01 inn Eft fit 


1 VlB 


11 3 

1 1 . B 


Service Center 


17,. 5 


17.0 


Escond 1 do 


8.8 


1 1 .5*** 


South Bay 


13.3 


19. 9*** 


El Caj on 


21.5 


18. 0*** 


Aae (XI 






24 Years or Leae 


8.1 


19. 0*** 


25 to 34 Years 


46.6 


51 .6*** 


35 to 44 Yeare 


33.7 


21 .1*** 


45 Years or More 


10.6 


9.3*** 


A u a p a n a Ann f Y a a p b 1 


B B . B 


31 1 AAA 

B 1 . 1 


Sex (%] 






Male 


15.6 


93.0*** 


Female 


64.4 


7.0*** 


Ethnicity (X) 






White* Won- HI s pa n 1 c 


56.fr 


53.1*** * 


9 Lack, Non-Hi spanl c 


20.5 


9.6*** 


H1 spa nl c 


18.2 


33.2*** 


Other 


4.5 


5.0 


Oegree Received (X] 






None 


38.1 


39.0 


General Equivalency Olplome 


7.5 


9.5*** 


Hlah School 01 dL odb 


53 .4 


51 . 5 


Averege Highest Grede Con pie ted 


11 .3 


11.2 


Currently 1n School (X) 


9.8 


4.7*** 


Merltel Statue (X] 






Never Married 


16.0 


6.9*** 


Merrled, Living With Spouse 


12.9 


89.7*** 


Merried, Not Living With Spouse 


34.1 


1.6*** 


01 vor cedff W1 doaed 


37.0 


1.9*** 



(contl nued] 
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TABLE 2.3 (continued] 



Characterl etl c 



Average Number of Children by Age 
Leee Than 4 Yeere 
4 to 5 Yeere 
6 to 12 Yeere 
13 to 1B Yeere 

Average Number of Children Under 
19 Yeere of Age 

Any Children (%]* 
Leee Then 6 Yeere 
Between 6 end 1B Yeere 

Prior AFOC Dependency (X] 
Never on AFOC 
Two Yeere or Leee 
More Then T»o Yeere 

Averege Honthe on AFOC Ourlng Two 
Yeere Prior to Application 

Averege Honthe Unable to Work Oue to 
MedlceL ProbLeae In Two Yeere 
Prior to Application 

Received Unemployment Compensation 
in the Quarter £M or to 
Application (X) 

Averege Amount of Unemployment 
Compensation 1n fa the Querter Prior to 
Application (I) 

Held Job et Any Time Ourlng Four 
Quertere Prior to AppLlcetlon 1%) 



Held Job Ourlng Querter Prior 
to AppLlcetlon [%} 



Averege Eerninge Ourlng Four Quertere 
Prior to AppLlcetlon ($] 



Averege Eerninge Ourlng Querter 
Prior to AppLlcetlon ($] 



AFOC 



0.15 
0.07 
0.83 
0.58 



1.74 



18.4 
B7.5 



33.7 
38.8 
27.4 



6.1 



1.1 



11.6 



104.24 



51 .5 



33.1 



2638.54 



621.20 



AFOC-U 



0.82*** 
0.25*** 
0.68*** 
0.28*** 



2.13*** 



77.7*** 
48.8*** 



58.5*** 
36.0*** 
5.6*** 



2.3*** 



0.5*** 



22.7*** 



212.26*** 



71.4*** 



50.2*** 



6302.20*** 



1447. B8*** 



(contl nued) 



ERLC 



-29- 



75 



TABLE 8.3 Icontl nued) 



Character! et1 c 


AFOC 


AFOC-U 


Average Months Employed OuHng Two 
Years Prior to Application 


10.1 


15.7*** 


For Longest Job Held In Past 

Two Years 

Averege Hourly Vage Rate (9) 
Averege Weekly Hours 
Ouretlon of Job [Honths] 


5.13 
3B.B 
82.0 


7.01*** 
40.3*** 
28.4*** 


e 

Totel Sampl e 


3581 ' 


340 B 



SOURCE: Celculetlona fron NORC Client Information Sheets, program 
tracking records end UI earnings and benefits records fron the EPP Information 
By stan. 

NOTES; 01 str 1 but 1 one say not add exectly to 100.0 percent because of 

r o u r. •■ 1 n g • 

°0 1 st r 1 fc'j 1 1 uns nay not add to 100.0 percent because applicants can 
have children 1n wore then one category. 

b Celculeted from Unemployment Insurance benefit rscords from the 
State of California. 

Celculeted from Unemployment Insurence earnings records from the 
State of California. 

d For questions concerning longest job, aemple sizes are baaed on 
the number of applicants who report a longest job on the Client Informetlon 
Sheet. Oue to missing data for selected character tst1 cs, these •-sampler elzes 
very from 241B - 2548 for AFOC 1 a and 3078 - 31B5 for AFOC-U 1 a. 

For aelectad characteristics, sample sizes mey very up to 
oevantaan aampla points due to missing data. 

Differences between assistance categories ere statistically 
significant using a two-tailed t-test or ch1-squere test et the following 
levelat * = 10 percent; ** = 5 percent; *** = 1 percent. 
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This report will therefore analyze the AFDC and the AFDC-0 groups 
separately. Another reason for separate analyses is the different pro- 
cedures governing the calculation of welfare grants in the two programs* 
These were expected to affect the participation, employment and welfare 
behavior of the two groups, and are discussed briefly below. 

During most of the period studied, welfare applications were approved 
if an applicants total income did not exceed 150 percent of the state 
standard of need. (However, during the later part of the follow-up period, 
when the rules of the Deficit Reduction Act (DEFRA) went into effect, this 
limit was raised to 185 percent.) The benefit level paid reflected the 
amount that income fell short of the state payment standard. As of October 
It 1984, the maximum benefit for a family of three in California was 
$555, 11 the second highest in the nation; payments ranged widely among 
other states, from $719 in Alaska to $96 in Mississippi. 12 This relatively 
high level in California makes it easier to combine welfare receipt with 
earned and unearned income. 1 3 Chapter 3 will discuss this issue further. 

When recipients of AFDC take Jobs, earning* are considered in the 
monthly calculation of welfare payments, but grants are not reduced dollar 
for dollar. The amount of the grant is determined in the following manner. 
Allowable work-related and child-care expenses are deducted from earned 
income to arrive at net earnings. In addition, the first $30 plus 1/3 of 
the net earnings is disregarded for the first four months in which 
recipients earn income. (Late in 1984, the ruling was changed to extend 
the disregard of $30 for an additional eight months.) After these 
deductions and disregards, the earnings that remain are considered 
countable. in determining the grant, the countable earnings figure is 
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subtracted from the state payment standard based on family size. The grant 
amount is further affected by unearned income, over- and under-* payment s 9 
adjustments and prorations. 1 ^ 

Determination of the welfare grant is similar for the AFDC-D 1 s except 
for two important differences in federal regulations. First, AFDC-U's are 
no longer eligible for welfare once they work 100 or more hours per month, 
regardless of the amount they earn. Second, during most of the demon- 
stration period, if the AFDC-D case head is sanctioned, the entire case is 
closed, and no payments are made to the entire family during the sanction- 
ing period. (In mid-1984, this rule changed so that in California, some 
aid became available for family members.) 15 In contrast, if an AFDC case 
head is sanctioned for not complying with program requirements, only his or 
her needs are deducted from the family's monthly grant payment, usually for 
three months for the first sanction and six months for the second. 

Thus, AFDC's have more latitude to earn money and still receive 
welfare benefits than the AFDC-D 1 s, who more quickly lose welfare benefits 
when they work and face stricter penalties for not complying with program 
requirements. 

3. Subgroup Characteristics 

The research will examine subgroups of the sample to address the 
important issue of whether certain categories of individuals are likely to 
benefit more f^ox ore or both of the San Diego models. The impact and, to 
a lesser extent, the benefit-cost analysis thus focus on several important 
subgroups. As ' iready mentioned, the primary division is between the 
AFDC's and the AFDC-D 1 s. 

In addition, given the research sample's enrollment over a yearlong 
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period, it will be important to determine if the operation of the programs 
differed systematically between the earlier and later enrollment periods. 
Table 2.4 indicates that there 1a, in fact, some variation in 
characteristics. Individuals in tt/« *fcor period seemed more dependent on 
welfare and had a history of less prior employment and earnings than the 
Ootober to March sample. The later sample also included more black 
applicants and fewer individuals who had received 01 benefits in the 
quarter prior to random assignment. In part, the improving economy in San 
Diego during the later period may explain this variation, as Job-ready 
individuals ~ forced in the earlier period by a poor economy to apply for 
welfare — may have found employment easier to obtain. This issue is 
discussed in more detail in Chapters 3 and 4. Later AFDC applicants were 
also less likely to be in school and to have children under six years of 
age. 16 

The second report suggested that certain other subgroups may have been 
affected in different ways by the San Diego programs. One important set 
examined was determined by the extent of prior employment csjfer «»nee. As 
expected, AFTf f s who had held employment at some time during :.ne year prior 
to welfare application were less likely to have received welfare benefits, 
but more likely to have received 01 benefits than those who were not 
employed. (See Table 2.5.) Applicants with recent work experience also 
tended to be more educated and were more likely to have children less than 
six, a finding that characterized the AFDC-U subgroup as well. 

4. Research Samples for the Different Analyses 

The two analyses in ttiis report — impact and benefit-cost — use 
somewhat different research samples and follow-up periods. Table 2.6 
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TABLE 2.4 



SAN OIEGO 

SELECTED CHARACTERISTICS OF THE RESEARCH SAMPLE, BY ASSISTANCE CATEGORY ANO APPLICATION PERIOO 

(OCTOBER 1882 - AUGUST 1983 8ANPLE] 





AFOC 


AF0C-U 


CharactaH atl c 


Octobar 1882 - 
March 1083 


April - 
Auguat 1883 


Octobar 1988 - 
March 1963 


April - 
Auguat 1983 


AviPiOi Anm f Y» m r m 1 


33. a 


34. 3*** 


31.2 


31.0 


8ax (X) 
Mala 
Faaala 


16.3 
83.7 


14.5 
85.5 


92.8 
7.1 


93.3 
6.7 


Ethnicity' [X] 

wiii •» ■ p nun n i ■ p ■ ii i »» 

Black, Non-H1 apanl c 

H1 apanl c 

Dthar 


57.7 
18.8 
18.7 
4.6 


55.8 
83.8*** 
17.4 
3.8 


53.5 
7.8 

33.1 
5.6 


52.8 

8.8** 
33.4 

4.2* 


Dagraa RtcalvaH [%) 
Nona 

Ganaral Equlvaiancy Dlploaa 
High School Dlploaa 


40. 0 
7.1 
52.8 


37.8 
8.1 
54.3 


39.3 
8.8 
50.8 


36.6 
8.1 
52.3 


Currently In School [X] 


11.8 


6.3*** 


5.2 


3.8* 


Anv Ch1 L drin 1*1* 

Laaa Than 6 Yaart 
Between 6 and 1B Yaara 


84.8 
63.8 


7.8*** 
83. 3*** 


77.4 
51 .5 


78.1 
47.4** 


Prior AFOC Oapandancy [X] 
Navar on AFOC 

Tao Yiirt op Laaa 

Nora Than Two Yaara 


35.3 
38.8 
25.8 


31 .1*»* 
38.8 
30. 0*** 


58.5 
36.6 
4.6 


58.4 
35.0 
8.6** 


Avaraga Nontha on AFOC During Two 

YiiPi Dp j np to Annl i eiti nn 
i ■ ■ i ■ r m iui u nppi 1 bl i i on 


6.1 


6.0 


2.2 


2.3 


Hold Job at Any T1aa During Four fa 
Quarters Prior to Application [X] 


53.3 


48.5»»* 


74.2 


67. 3*** 


Avaraga Earnlnga During £our Q»»ertcre 

Prior fn innl 1 eiti >in fll 


8876.86 


8576.81 


6588.13 


5658. 72*** 


Evar Racalvao Uneaployaent 
Coapanaatlon In tha Quartar 

Prior to Application [X] 


12.8 


10.1*** 


83.8 


20.8** 


Avaraga Aaount of Unaaployaant 
Coapanaatlon In tha Quartar 

Prior to Application (•) 


111.00 


80.01* 


211 .88 


212.66 


d 

Total Saapla 


8823 


1368 


2042 


1364 



SOURCE t CelculeUo... froa MDRC Client Information Sheete, ui aarnlnga record? froa tha EPP 
Information 6yataa# and UI coapanaatlon racordo. 

NOTES t 01 a tr1 bu t1 ona aay not add axactly to 100.0 parcant bacauaa of rounding. 

B 01atr1but1ona aay not add to 100.0 parcant bacauaa appHcanta can hava chlldrin 1n aora 
than ona catagory. 

b 

Calculatad froa Unaaployaant Inauranoa aarnlnga racorda from tha Stata of California. 

C Calculatad froa Uraaployaant Inauranca banaflt racorda froa tha Stata of California. 

d„ 

For aalaotad oharactarl atl ca» aaapla elzee aay vary up to n1na aaapla polnto dua to 

a1 661 ng ua ta. 
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Olffarancaa bataaan application parloda althln aaalatanca catagorlaa ara atatl atl cal ly 
a1gn1f1cant ualng a tao-te1led t-taat or chi-equere taat at tha folloalng lavaiei * = 10 parcant; 
** * 5 percent; *** * 1 parcant. 

so 



TABLE 2.5 



SAN OXEGO 



SELECTEO CHARACTERISTICS OF THE RESEARCH SAMPLE, BY ASSISTANCE CATEGORY ANO .PRIOR EMPLOYMENT HISTORY 

[OCTOBER 1882 - AUGUST 1883 SAMPLE J 





AFDC 


AFDC* 


-u 


Characterl stl c 


Not Employed 1n 
Year Prior to 
Appl 1cat1 on 


Employed 
1n Year Prior 
to Application 


Not Employed 1r 
Year Prior to 
AppUcati on 


Employed 
1n Year Prior 
to Application 


Average Age [Years] 


33.8 


33.4 


31.7 


30.8** 


Sex (X) 
Hale 
Female 


13.8 
86. 2 


17.4*** 
82.6*** 


82.3 
7.7 


83.3 
6.7 


Ethnicity [%] 
White, Non-Hi apanlc 
Bleckt Non-H1 apanlc 
HI apanlc 
Other 


55.5 
22.4 
17.8 
4.2 


58.4* 
18. 7*** 
18.2 
4.7 


63.0 
8.3 

22.1 
5.7 


49.3*** 

8.4 
37.6*** 

4.7 


Oegree Received (X) 
None 

General Equivalency Olplome 
High School Olplona 


44.4 
8.8 
46.7 


33.8*** 
6,2*** 
£?.B*** 


38.6 
11.3 
41.1 


3B.7 

8.8** 
52.5* 


Any Children (X) 
Lass Than 6 Years 
Between 6 and 1B Ysars 


17.0 
88.0 


18.7** 
86.9 - 


74.9 
50.8 


78.7** 
49.4 


>^or AFDC Dependency [X] 
Vjver on AFDC 
Two Year 8 or Lass 
More Than Two Years 


33.8 
38.1 
28.1 


33,3 
38.8 
26.8 


58.6 
34.B 
5.6 


57.8 
36.5 
5.6 


Average Months on AFDC Ourlng Two 
Years Prior to Appli cation 


7.2 


5.0*** 


3.0 


2.0*** 


Average Earnings Ourlng £our Quarters 
Prior to Application ($) 


0.0 


5130.12*** 


0.0 


8824.12*** 


Ever Received Unemployment 
Compensation In the Quarter Prior 
to Application [X] 


3.7 


18.1*** 


8.1 


28.6*** 


Amount of Unemployment 
Compensation 1n the Quarter Prior 
to Application [I] 


38.56 


165.78*** 


88.85 


262.0e*** 


d 

Total Sample 


1738 


1843 


872 


2429 



SOURCE ANO NOTES: Bee Table 2.4. 



For aelected characteristics! esaple eizee way vary up to ten sample points due to 




TABLE 2.6 



SAN DIE9D 

PRIMARY RESEARCH 8AHPLE8 FOR THE IMPACT AND BENEFIT - COST STUDIES 



udy 


Chiptir 


Outcoou 


Application 
Pari oda 


Nuabor of Folloa-Up 
Kontho After AppMeet'm 


c 

Total Biapli 81zo 
AFOC AFDC-U 


piot 


3,4 


Eeployeent, Eernlnga, 
felfere, ind HI BinifHi 
for Full Biapli in d 
8iliotid Bubgroupi 


Ootobar 18B2- 
Auguat 1883 


1H Month/ 


3231 






Eeployeent, Eirnlngi, 
felfere, an d Ul BinifHi 
for Early AppUcent 
3eepl« 


Octobor 1882- 
Haroh 1883 


24 Nontha b 


1850 1763 


mflt - Coit 


6 


Nit Bini^Ui ind Com 


October 18B2- 
Harch 1863 

April 1863 - 
Aupuat 18B3 


21 to 26 Month! 
15 ta 23 Monthi 


2223 2042 
1888 1384 



For ■•ployaont an d eernlnge, tha folloa-up period 1i i*^e quartan iftor tha quarter of randoe eeelgneent. 



For eeployeent and eernlnge, tha folloa-up period 1e seven quortoro after the querter of randoe eeelgnaent. 

c 

Includee Job 8oorch-E»EP ExpoHeontol, Job Search ExpeHeentol end Control reeterch groupo. For aoaa of the 
:ee eey be ellghtly lover due to aleelng dote. 
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indicates the primary samples for both of these studies. 

As the table shows, the impact analyses in Chapters 3 and 4 will 
present the effects of the two program models on employment, earnings, 
welfare and 01 benefits separately for the AFDC and the AFDC-U assistance 
categories. The impaot sample consists of people who applied for welfare 
from Ootober ?982 through August 1983 for whom key data were not missing. 
The full sample was followed for a fixed period of time, between 15 and 18 
months after welfare application. This sample is also used in the analysis 
of selected subgroups: those differing in their extent of prior work 
history, welfare reoeipt and reoeipt of 01 benefits, as well as number of 
children. Also, because of notable differences between the early and later 
enrollees, speoial e^tention will be given to the variation in impaots by 
time period of welfare application. Finally, an additional six months of 
follow-up is available for the ~*rly grou^ 01' applicants and will be used 
to discern longe v, -terir trends. 

The benefit-cost study is aiao baa^d on the full sample, but inoludes 
some people who had been excluded from the impact sample. 17 In contrast to 
the impaot study, it makes use of all available follow-up data, although 
the amount varies depending on when an individual applied for welfare and 
the data source. For example, in the case of earnings data, the earliest 
enrollees have eight quarters (or 24 months) of follow-up data, vhile the 
latest enrollees have five quarters (or 15 months) of data after the 
quarter of application. 

C Data Sources 

The research design used a mixed strategy to analyze patterns of parti- 
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cipation in Job search and EWEP, to describe implementation factors, to 
measure employment and welfare outcomes, and to estimate program benefits 
and oosts. The data sources were thus many and varied. Of particular 
importance in this project and others in MDRC's demonstration has been the 
use of administrative records to measure key outcomes, A dete^ed dis- 
oussion of this methodology appears in the section following this brief 
description of the data aouroes. 

The four primary sources of information were the Client Information 
Sheets (CIS), designed by MDRC *r m I nied out at welfare application; the 
EPP Information System (EPPIS), attained by the State of California; the 
County EWEP attendance logs; and the Unemployment Insurance benefit 
records. These are discussed below. 

• Client information Sheets, introduced by MDRC as part of the 
random assignment process, provide information on the demo- 
graphic characteristics of sample members. The data were 
merged by the state into the EPPIS files. 

• EPPIS is a compilation of several data sets: 

• APDC records supply information on monthly AFDC (i.e., wel- 
fare) grants and status (e.g , denial, discontinuances and 
approvals}. Tfees* <fcte were obtained directly from the 
County of San Diego and collected through February 1 jd5 for 
the analyses in this report. 

• The California St&fce PnftP)Pl9W Pfc Insurance (OH Earnings 
Records (the California Base Wage File) provide quarterly 
employment and earnings data reported by employers for each 
calendar quarter? e.g., January, February and March; April, 
May and June. These data were collected through the fourth 
quarter of 1984. 18 

• The EPP Reporting System contains information on program 
services, particularly on participation status in group Job 
search. Referral to EWEP, as well as to other regular WIN 
activities such as individual Job search, training or subsi- 
dized employment, is reoorded, as is information on EPP/WIN 
activities related to de registration and sanctioning. 
Program data were available through September 1 98^. 1 ^ 
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• Job Searoh Attend ance Logs recorded the days of attendance 
in the job searoh workshops and the number of unexcused 
absences. The logs also indicated the completion and 
employment status of individuals at the point of program 
departure. 

• flnariffig Job Blagggsnfc Assistance Lo^a provide data on referral 
ana placement by the welfare office at the time of welfare 
applioation. 

• Pnwplovment Insurance Bunef it BfififlCdfl supply information on 
monthly 01 benefit (Unemployment compensation) payments, 
obtained from the state. 01 benefits data were collected 
through March 1985. 20 

t BHBP Lfigfl are maintained by the San Diego Workfare Unit with- 
in the DSS. Employment Services Bureau. The logs contain 
information on EWEP referrals, whether or not individuals 
showed up at orientation or were assigned to worksites, their 
worksite attendance, completion status and any sanctioning 
activity, as well as reasons for nonpartioipation. Throughout 
the demonstration, the logs were oompleted by the EWEP staff 
at each of the local welfare offJces and periodically sent to 
MDRC. However, oomplete OfEP data are available only through 
February 1984, so the EWEP follow-up on sample members is 
slightly shorter than the EPP period. A limited nunber of 
EWEP activity logs were also missing at the time of this 
report, so these data may somewhat understate referrals. 21 

As indicated in Table 2.7, these data sources provide varying lengths of 
follow-up, depending on the application period of enrollees. 

Other data sources inolude two survey interviews, one administered to 
a randomly selected t oup of >[ plioants six months after random assignme^, 
and the other used with a random *jubsanr?le of worksite particle and 
their supervisors. A review of EWEP, EDD and welfare case folders for a 
small group of registrants, various fiscal records on program and partici- 
pant costs, and reports from a field researoher based in San Diego complete 
the main data collection activities. (Appendix B describes these data 
sources in more detail.) 
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TABLE 2.7 



SAN OIEGO 

LENGTH OF AVAILABLE FOLLOW-UP BY OATA SOURCE AND APPLICATION PERIOO 
[OCTOBER 1982 - AUGUST 1983 SAMPLE) 



Date Source 



I 



Lest Oete Oata 
Are Available 



Point at Which 
Oete Starts to 
8a Qollacted 



Length of Follo*-Up By Application Period 



I 



October - 
December 1882 



Jienuery - 
March 1983 



I 



April - 
June 1963 



July - 
August 19B3 



Program Records 



EWEP Activity Logo 



Quarterly employment 
and Earnings b/c 



Monthly *|elfare Grant 
3 ayr,ent8 



Monthly Unemployment 
[nsurence Hanefits 



September 1984 



February 1984 



Fourth^Calen- 
der Quarter 
of 1984 

February 1985 



March 1985 



Deto of 
Appl 1 cetl on 

Oata of 

App! Icetl on 

i 

Four Quarters 

Prior to 
Application 

Mpnth of 
Appl 1 cati on 

Six Montha 

Prior to 
Appl 1 cetl on 



Twenty-one 
Months 

Flftaan Hoothe 



El ght Que rters 
After 
Appl 1 ca (/ : v< 

Twenty-seven 
Months 

Twenty-el ght 
Months 



El ghteen 
Months 

Twelve Months 



Sevan Cluar'^re 
After 
Appl 1 cetl on 

Twenty-four 

Mo i She 

Twanty-f we 
Montha 



Fifteen Montha 



Nina Months 



SI x Quarters 

After 
Appl 1 cati on 

Twenty-one 
Months 

Twenty-Two 
Montha 



Thl rteen Months 



Seven Months 



Five Quarters 

After 
Appl 1 cetl on 

Nineteen Months 



Twenty Months 



NOTES: EWEP Log data provides slightly Isss past-appl Icsfcl jn follow-up for Individuals applying during 
the latter per; of any particular month. 

b 

Employment and earnings data are based on Unemployment Insurance earnings records whi" 
laming r , on a calender quarter beslB. 

C Cater^r quarter of application ta not considered to be a follow-up quarter for employmeit. und 
lerninga for the Sa.i Diego evaluation. 

d^ 

The first month of h~ first quarter of follow-up for welfere grent payments la the month In which 
in Indlvlduel applied for walfera. 

a 

The first month of the first quarter of follow-up for unemployment Ineurence benefits la the month 
n which an Individual applied for welfere. 
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D. The Dse of Administrat ive Records 

The reliance on administrative reoords to measure outocmeo m employ- 
ment, earnings, welfare and Unemployment Insurance compensation offers many 
advantages as well as some limitations. In mar.- previous studies, informa- 
tion ban been gathered by ?(Usrviewing sample members, both at program 
•tart-up and at seleoted points thereafter. Depending on the mailable 
resources, the thoroughness with which the survey is conducted and the 
mobility and cooperation of sample members, this method has been very 
reliable, but has usually resulted in sample attrition rates of from 10 to 
25 percent (and sometimes different r.;; ponse rates aoross researoh 
groups). 22 

Administrative records, in contrast, do not require ongoing oonteot 
with sample members, are » less expensive way to eolleot data, and may 
result In lower attrition rates in the later follow-up periods. Adminis- 
trative records also do not depend on the ability of individuals to recall 
preoise but important information, suoh as dates, household inoom© or the 
length of enrollment in programs or schools. However, administrative 
reoords are limited i; *Jr types of outcomes they measure and, as discussed 
in this section, have «l>.<»- drawbaoks in quality and completeness of the 
data. 

As stated above, Unemployment Insurance (01) earnings reoords, main- 
tained by the State of California, are the primary souroe for sample 
member s» employment and earnings, and AFDC payment reoords, kept by the 
County of San Diego, are the main souroe for welfare reoeipt. These data 
allow an unbiased comparison of employment and welfare outcomes between the 
experimental and oontrol groups for as long a follow-up period as may be 
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desired. Overall, in the San Diego evaluation, the administrative records 
were found to be complete. 2 3 ^ n independent check of quarterly earnings 
with EPPIS data indicated that the files matched properly with the 01 
system. Further, only 9.5 percent of the AFDC sample and 11.0 percent of ' 
the AFDC-D sample lacked information on welfare payments for one or more of 
the first 12 months of follow-up. 2 * However, despite the high quality of 
these two sources, the use of administrative records as the main data br.se 
for the impact study does raise some important questions as discussed 
below. 

First, because of the report* <? lags typical of the 01 wage reporting 
system, data for the full sample were available only through six quarters 
of follow-up, although a follow-up of nine quarters was possible for the 
earliest sample members. (This includes the quarter in which azi ^dividual 
is randomly assigned.) Second, figures for the fourth quarter of 1984 
should be considered preliminary because seme employers may have been late 
in reporting earnings to the system. 

Third, 01 earnings records provide somewhat limited coverage. The 
date do not include people who have moved or who work out of state, or 
those for whom employers do not report earnings, especially domestic 
workers. Off-the-books earnings are also never in these records. Never- 
theless, there is no reason to expect that these coverage issues introduced 
■ajor biases since experimental a and controls should have both been affect- 
ed to the same extent. In fact, a comparison of the six-month applioant 
survey and the 01 earnings records showed that the discrepancy in the 
proportion of individuals employed according to these two data sources was 
fairly similar across research groups. 
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Finally, sinoe earnings are re^rded by calendar quarter, the quarter 
of welfare application reflects zero to two months of post-application 
follow-up, depending on when in the calendar quarter an individual applied 
for welfare. For example, sinoe information was collected starting in 
October 1982, an individual applying for welfare in that month had approxi- 
mately two months of follow-up aotivity *n the quarter of welfare appli- 
cation (which ended in December), while an individual applying in the 
month of December, the same quarter would show mostly the activity before, 
not after, welfare application. 

Thus, the quarter of application is not a true follow-up quarter for 
earnings. Because time lapsed between random assignment (i.e., welfare 
application) and the next activity (usually program registration but some- 
times employment), the quarter of random assignment could contain little 
post-program employment aotivity but report earnings through the 01 system 
from jobs held prior to welfare application. As a result, quarter 2 is con- 
sidered the first true quarter in measuring impacts, and reflects applicant 
behavior during the three-to-five-month period after welfare application. 

In contrast, because » *lfare datp ?re reported monthly, the first 
month includes the day of c;. Miration; ic is thus a true follow-up month 
since sample members were ncv on welfare immediately before application. 
In the organization of data for this study, welfare payments are aggregated 
into three-month time periods where the first month of the first follow-up 
quarter is the month in which an individual applies for welfare. Thus, 
while data on welfare receipt and payments are not exactly comparable by 
period with employment and earnings information, the match is close. 

One important issue was missing welfare records. For consistency, 




sample members with missing records were eliminated from the estimation of 
all impacts. This may have resulted in slightly greater earnings impacts 
than would have been the case if all sample members, including those with 
missing welfare data, had been included in the estimation of employment 

impacts. 2 ^ 

Unemployment Insurance benefits data, also reported monthly, are avail- 
able for the full sample for six months prior to the month of application 
and for at least 18 months after application. As in the case of welfare, 
these data have been aggregated into three-month periods, in which the 
first month of the first follow-up quarter is the month of random 
assignment. 
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CHAPTER 3 

AFDC APPLICANTS: EMPLOYMENT, earmihgs V[ELEAB£ IMEAfilS 



Chapters 3 and 4 summarize the employment, earnings and welfare 
impacts produced by the two San Diego program models: Job search alone 
(EPP) and Job search followed by community work experience (EWEP). This 
chapter focuses on findings for. the AFDC applicants, a primarily female 
assistance group. Chapter i| examines impacts for the mostly male AFDC-U 
group. 

A. The Impact Analysis neslgn and Saiimip 

The chapter begins with a brief discussion of the differences in 
program treatment for sample members in toe three main research groups. It 
then presents the overall program impacts, with a special focus on the 
following four major questions; 

• Dc either or both of the two experimental programs affect 
sample members' employment, earnings, welfarr receipt or the 
level of payments? 

• Are there any incremental impacts from the add-on of community 
work experience (EWEP) to the Job search component beyond 
those resulting from the workshops alone? 

• Are the observed impacts stable and consistent across appli- 
cation periods? Do they tend to increase decay over time? 

• For what subgroups do the programs work best, and how do their 
various outcomes influence the overall pattern of program 
impacts? 

To examine these issues, several samples were used. First, data were 
analyzed for the full sample of AFDC applicants (3,591 individuals) whc 



-45- 

93 



applied for welfare and were randomly assigned between October 1982 and 
August 1983. 1 This sample was tracked for 15 to 18 months to collect five 
quarters of post-application earnings data (quarter 1 is not a true 
follow-up quarter) and six quarters of welfare and Unemployment Insurance 
benefits (with all quarters capable of reflecting impacts). By the end of 
this follow-up, most experimental were no longer receiving program 
services. 

Subgroup samples were drawn from this full sample and were also 
analyzed over the -15- to 18-n-onth follow-up period. The patterns of 
applicants enrolling in the early versus the later demonstration period 
were especially important to examine, given the changing labor market 
conditions in San Diego ^ee chapter 2) and their different character- 
istics. (The second report focused on this early group.) Other important 
subgroup sets were the "more employable" compared to ihe "less employable" 
applicants, as defined by recent work history, and those subdivided by 
level of prior welfare dependency, as well as numb" of children. 

Two quarters of additional follow-up data were available for an early 
sa>- e of applicants: 2,223 AFDC's enrolled from October 1982 through March 
15~->» a group representing 62 percent of the total AFDC sample. This 
longer follow-up was used to estimate the direction and the possible 
magnitude of impacts over time. 

In all these analyses, impacts were calculated by oomparing the 
employment, earnings, welfare and 01 benefits outcomes of the Job Search 
only group and the Job Search/EWEP experimental a — both registrants and 
nonregistrants, as well & 9 participants and nonpar ticipants — to those of 
all controls. 2 To isolate the effeots of adding the work experience 
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*juirement after Job search, the outcomes of the Job Search/EHEP 
experimental s were compared to those of the Job Search only group. 

B - .EXMrimental-Contml Treatment Differences 

As background for the disoussion of program impaots, this section 
summarizes the differences in service levels for the experimental and 
oontrol group mcabers. This information is particularly important in an 
experimental design, where control group behavior serves as a measure of 
what individuals would have done in the absence of a special program. In 
this evaluation, the control group members wre eligible to take part in 
regular WIN services, typically the kind of activity available to welfare 
applicants if neither of the two experimental programs had been operating. 
The experiences, or outoomes, of the controls thereby set a standard 
against which the achievements of the experimental groups can be assessed. 

Table 3.1 shows that ther^ were large differences in program activity 
levels. While almost one-half of the experimental group members were 
engaged in some significant activity during the six months after welfare 
application, only 5 percent of the control group memters recorded any 
activity. When the follow-up period was extended to nine months, 
participation levels increased by at most two percentage points. (See 
Appendix Table C.1 and Chapter 1 for s discussion of the AFDC participation 
rates in EPP Job Search and EWEP.) Thus, people participated fairly 
quickly if they were going to do so at all. 

The type of program activity was also very difx'erent for the three 
research groups. While the main activity of experimental s was a Job search 
workshop, plus a work experience position for the Job Search/EWEp group, 



TABLE 3.1 



SAN OIEGO 

AFOC APPLICANTS! SIX-MONTH PERFORMANCE INOICATORS, BY RESEARCH 6 ROUP 
(OCTOBER 1982 - AUGUST 1983 SAMPLE) 





Experimental 


Control 


Six-Month Perforaence Indicator 


Jab Seerch- 
EWEP 


Job Seerch 


WIN 


Received Job Pleceaent Aeslstsnce (X) 


88.8 


80.7 




Regletered With EPP/VIN [X] 


65.5 


85.7 


86.8 


Pertldpeted 1n Any Post- 
Ragl strati on Activity [X] 


44.6 


47 .5 


5.1*" 


Psrtldpstad at Laaat 
Ona Oay 1n Job Saarch 
Workshop [X] 


48.3 


45.3 


0.8*" 


Worked at Laast Ona Hour at 
an EWEP Worksite [X] 


11 .8 


0.0 


O.O*** 


Received Other 
EPP Services [X] 


4.1 


4.8 


A A 


Progrea Pleceaent 
(Found Eaployaent) [X] 


85.6 


85.3 


13.2*** 


OareQletered Froa EPP/VIN [X] ! 


58.1 


48.7 


40. B*** 


Oue to Requaat for Sanction (X) 


6.6 


5.7 


0.7*** 


b 

Total Applicants 


1540 


867 


888 



SOURCE t MORC oelculatlonB froa the EPP Inforaetlon System and EWEP Activity 
Loge aelntelned by the 8en 01ego County Oepertaent of Social Services. 

NOTES t All perforaence 1nd1cetore ere celculeted as e percentege of all 
lapect eearle aeabers 1n tha Indicated reeeerch group. 

"progrea pleceaent Inforaetlon 1s besed on eaployaent that 1s reported 
to progrea eteff. Progrea placement dete a*U not be ueed to aeesure lapects. 

b Excludes eppUcents alsslng AFOC peyaents for one aonth or sore 
during the flrat six aonths after application. 

Differences between reeeerch groupe althln en essletence cetegory ere 
ststlstlcslly significant using s tao-tslled t-test et the following Levelst • = 10 
percent} = 5 percent! *** = 1 percent. 
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control group members in WIN — if they participated in anything — were 
usually enrolled in individual Job search (a much less intensive service 
than group Job search). Only a small number of applicants in all three 
research groups were involved in training either within or outside of If IN. 
Finally, while most experimental s reported for the one-day Job placement 
activity, only a handful were actually referred to a specific opening and 
less than two dozen accepted a Job offer. 

Although the experimental groups received more services than the 
control group, their participation levels were not universal. This 
reflects not only a small number of program-approved deferrals and 
exemptions (because of illness or language difficulties), but also factors 
not related to the programs 1 participation requirements. Many departures 
from the rolls or program terminations prior to participation were due to 
the typical turnover in the welfare caseload: that is, in the normal 
course of events, [people will leave welfare (and thus the program) because 
they find Jobs on their own or because their family income or circumstances 
have changed. A major reason for welfare departure, for example, is 
remarriage. 

In other cases, departures may be more closely linked to a special 
program, particularly mandatory ones, such as these San Diego models. 
Applicants may prefer to withdraw from the rolls or seek employment on 
their own rather than participate in a mandatory activity. Others may fail 
to comply with program rules and be sanctioned, or temporarily deregistered 
from the program. All of these factors — whether related or not to 
program requirements — reduce the pool of eligible persons with whom 
program staff can work during a specified period. 
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Thus, a more comprehensive measure of program performance is used in 
this evaluation. It takes into account not only participation in program 
activities, but also the registrants' ongoing eligibility to take part in 
the services. The approach, described in Chapter 1 and in detail in the 
second report, seeks to measure program success by determining how many 
sample members still remain on welfare and registered with the program at a 
particular point in time without having completed program requirements. 
The critical questions are: Among those receiving welfare and continuously 
registered in either the experimental or the WIN programs as of the ninth 
month after application, (1) How many had completed or were completing the 
required activities, and/or were employed? (2) How many never participated 
or dropped out? The size of this second "uncovered" group as a proportion 
of all applicants who initially registered with the program can signal the 
program's failure to persist in providing adequate services to an eligible 
caseload. 

As indicated in Appendix Table C.2, there were major differences 
between the experimental and control groups when the "coverage" analysis 
was conducted — in the level of activity among those continuously enrolled 
in either the experimental programs or WIN* as well as in the proportion of 
sample members deregistered due to sanctioning. Experimental s were not 
only more likely to be "out of reach of the program" (that is, off welfare 
or deregistered), but also substantially more likely to have completed or 
to be completing program activities at the ninth month. While only about 9 
percent of all experimental registrants were still in the program but had 
not oompleted the requirements or found employment, almost one-quarter of 
controls were in the "unserved" oategory.3 



-50- 

98 



Additionally, it appears that most of the 9 percent of the unserved 
registrants in the experimental programs had not been ignored by program 
staff. When a special review was conducted on the case files of a 
subsample of experimental registrants to determine their reasons for 
nonparticipation, most were found to have been officially deferred or 
exempted for reasons such as poor health, language difficulties or union 
membership. However, higher levels of sanctioning also contributed to the 
substantial coverage difference. . Within the nine-month period, between 6 
and 8 percent of the experimental s were deregistered from one of the two 
programs because of a request for sanctioning: less than 1 percent of the 
controls in the more limited WIN Program were deregistered for this reason. 
(See Appendix Table C.1.) 

Thus, both measures of participation indicate that San Diego operated 
a mandatory job search and work requirement, and that there were signifi- 
cant and large differences in the program treatment between the experiment- 
al and oontrol groups, as well as between each of the two program models. 

C. Impacts on Employme nt, Earnings and Welfare 
1. Earlier Findings 

The second report presented impacts for an early sample (approximately 
62 percent of the full sample) tracked roughly for a year after application 
as well as impacts for the full sample for six months following welfare 
application. Data for the full sample showed (and the longer-term 
follow-up of the early sample confirmed) that both programs produced 
substantial and statistically significant employment and earnings gains for 
the AFDC group, but only modest reductions in welfare receipt and payments. 
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The report emphasized that these findings probably reflected only the 
job search effects of both models since many Job Search/EWEP experimental s 
were still in their work experience positions at the end of the follow-up 
period. Thus, the findings were inconclusive about the effectiveness of 
adding a work experience requirement to the Job Search model. It was more 
evident that the "threat" or existence of a work requirement had not thus 
far deterred people from completing their welfare applications or changed 
experimental s 1 behavior during the workshops, although this finding was 
preliminary. 

In this final report, these earlier results are held up to more 
detailed scrutiny. However, while the follow-up period is now of adequate 
length to isolate the effects of the work requirement, it is important to 
bear in mind that the average impacts for the full sample do not tell the 
whole story. As stated previously, the sample was enrolled over an 
extended period — 11 months beginning in October 1982 and averages can 
mask diversity and substantial change in behavior over time. There were in 
fact notable differences in the background characteristics of the appli- 
cants entering the sample in the early and later demonstration periods, as 
well as changing labor market conditions. Thus, as Section E will show, 
findings for the full sample do not reveal an important finding discussed 
later: the direction and magnitude of some of the impacts for one program 
— Job Searoh — differed markedly, depending on when applicants entered 
the sample. In turn, this influe; *s overall conclusions using the full 
sample. 

2. Final Impacts 

Overall, for the full sample, the additional follow-up in this report 
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suggests that the six-month improvements in employment and earnings seen in 
the second report continued for the Job Search/EHEP experimental s over a 
15-*onth period. Early impacts for the Job Search only experimental s, 
however, bad all but disappeared by quarter 4, as shown in Table 3.2. As 
will be discussed in Section E f the rapid deterioration of the employment 
and earnings gains of this group as a whole was being driven by the 
behavior of the later Job Search applicants — those entering the sample 
after March 1983. For those applying before April 1983 (the focus of the 
second report), employment and earnings gains persisted through the sixth 
quarter. Welfare savings are small but positive in this report and the 
prior one, although those for the Job Search/EHEP group are slightly larger 
and more consistently statistically significant. 

When the findings of this report are studied in more detail, Ifcble 3.2 
shows thao, over the five-quarter follow-up period, Job Search/EHEP 
experimental experienced a statistically significant employment increase 
of 5 .6 percentage points. 5 This was associated with a statistically 
significant earnings gain of $700, or a 23 percent improvement over the 
control group average of $3t102 during this period. The overall five- 
quarter employment gain was similar for the Job Search only experimental s 
(5.1 percentage points), but the $251 earnings gain was considerably 
smaller and not statistically significant. 

Quarter-by-quarter, the Job Search/EHEP model produced employment 
gains that were from 3.8 to 7.8 percentage points higher than control group 
employment. Earnings Increased per quarter by between $117 and $163, with 
the gains peaking in quarters 3 and 6. 6 (See Figures 3.1 and 3.2.) All of 
these impacts were statistically significant. In contrast, the Job Search 
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table a.e 



8AN 02E60 

AFOC APPLICANTS t IMPACT 8 OF J 08 SEAR CH-EWEP ANO JOB SEARCH 
(OCTOBER 188E - AUGUST 198S IMPACT SAMPLE) 



T 





Job 


Starch - 


EWEP 


Job Saarch 


Dutoooa and Fol low-Up Qutrttr 


Expar laantal 


Control 


Olf f oranoa 


Exparlaantal 


Control 


01 f f oranca 


Evtr Eaployodi Qutrttrt 
8 - 6 IX]' 


81.0 


55.4 


♦ 6.6*»* 


60.5 


56.4 


♦ 6.1** 


• 1th Etployttnt» Qutrttrt 
2 - B* 


2. OS 


1.73 


♦ 0.88*** 


4 DO 


4 79 


a n 4 A 
♦ O • 1 4 


Evtr Eaployad [X] 

Qutrttr of Application 

Qutrttr E 

Qutrttr 8 

Qutrttr 4 

Qutrttr 6 

Qutrttr 6 


85.5 
86.8 
40.8 
42.4 
48.8 
41.8 


33.1 
86.7 
32.3 
86.8 
37.5 
38.1 


4-8.6 

♦ e.8*»* 

♦ 7.8»»* 

♦ 6.6»»* 

♦ 6.4*** 

♦ 3.6* 


32.8 
87.8 
36.9 
38.4 
37.8 
37.4 


33.1 
88.7 
32.3 
36.8 
37.6 
38.1 


- 0.2 

♦ e.6*** 

♦ 4.8** 

♦ 1 .6 

♦ 0.4 

- 0.7 


Avtrtgt Tottl Earning*! 
Quartara 2 - B [I] 


3 801 .75 


3101 .63 


♦ 700.12*** 


ggcg q a 
osoe .MO 


«S1 U 1 . o*j 


xflRl 9 0 

♦eol ■ a c 


Avaraga Total Earnlnga [I] 
Quartar of Application 
Quartar 2 
Quartar 3 
Quartar 4 
Quartar 5 
Quartar 8 


359.46 
BOB. 51 
700.86 
808.68 
848.33 
833.38 


836.66 
886.87 
638.40 
698.58 
728.11 
772.75 


♦ 22.59 

♦ 140. 64*** 

♦ 162. 66*** 

♦ 117. 08»* 
+ 118. 23** 

♦ 180.84*** 


367.86 
486 .60 
658.04 
668.88 
742.42 
788.01 


33B.88 

9 9 9 9 7 
a a o ■ U / 

53B.40 
682.52 
728.11 
772.75 


♦ 30.80 

+1 1 / ■ / 4* w 

♦ 117. 64** 
- 83.63 

♦ 13.31 
+ 86.86 


Evar Racalvad Any AFOC 
Payaanta* Quartara 1-8 [X] 


83.8 


84.3 


-0.4 


85.2 


84.3 


♦0.6 


Avaraga Nuabar of Month* 
Quartara 1-6 


8.13 


8.61 


-0.48* 


8.33 


8.61 


-0.26 


Evar Racalvad Any AFOC 
Payaanta IX] 

Quartar of Application 

Quartar 8 

Quartar 3 

Quartar 4 

Quartar 5 

Quartar S 


78.3 
64.2 
51 .8 
46.8 
38.5 
35.0 


80.3 
67.6 
56.2 
47.8 
41.1 
36.2 


-2.0 

-3.4* 

-4.6»* 

-2.0 
-1.7 
-1 .2 


78.5 
6B.2 
52.2 
45.5 
42.3 
36.2 


80.3 
87.6 
58.2 
47.9 
41.1 
38.2 


-0.7 
-1.4 
-4.0* 
-2.4 

♦ 1.1 

♦ 0.0 


Avirim Tnti 1 AFDC Pivuntn 

Racalvad* duartara 1 - 6 II] 


3408.32 


3686.84 


-287. 62** 


9484 .05 


Q B Be OA 

86 86 .84 


-ana on 
"CUcittu 


Avaraga AFDC Payaanta 
Racalvad II] 

Quartar of Application 

Quartar 2 

Quartar 3 

Quartar 4 

Quartar f 

Quartar 6 


733.60 
885.38 
581 .84 
618.81 
4B8.08 
488.81 


752.03 
765.07 
663.34 
679.50 
601. 80 
445.28 


- 18.43 

- 86. 66*** 

- 71.39*** 

- 66. 68** 

- 38.14 

- 88.88 


727.83 
718.88 
585.34 
530.90 
477.01 
447.01 


752.03 
765.07 
853.34 
578.50 
501 .20 
445.26 


-24.40 

-46.82* 

-58.~00* 

-48.20 

-24.20 

♦ 1.72 


Baapla 8Ua 


1502 


873 




858 


673 





(contlnuod) 
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TABLE 3.2 (continued] 



SOURCE t HORC cilculitloni froo County of San 01ego valfare rtcords and Unaeployeent Inauranca aarnlnoa 
racorda from tha EPP Inforaatlon Syataa. 

NDTEGj Thaaa data include zero valuaa for aaapla eeeber* not aaployad and for oaapla aaabara net 
racalvlng aalfara. Thaaa data ara rc*gree§1 on-adj uatad using ordinary laaat aquaraa, controlling for 
pra-appU ca t1 on oharacta r1 at1 ca of aaapla aaabara. Thara aay ba aoae d1 sera panel a c 1n calculating auaa and 
dlffarancaa dua tc rounding* 

*Quartar 1, tha quartar of application! ««y contain oooa aarnlnga froo tha parlod prior to 
application and 1a tharaforo axcludad froo tha imurii of total follow*up oaployoant and aarnlnga. 

A s*o*to1lad t-teet «n applied to dlffarancaa between axparlaantal and control groupo. 
Statistical significance lavala ara Indicated aax • » 10 parcantj ■ 5 percent; * 1 percent. 
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FIGURE 3.1 



AFDC APPLICANTS: 
TRENDS IN QUARTERLY EMPLOYMENT RATES 
(OCTOBER 1982-AUGUST 1983 IMPACT SAMPLE) 
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SOURCE: See Table 3,2. 
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FIGURE 3.2 



AFDC APPLICANTS: 
TRENDS IN AVERAGE QUARTERLY EARNINGS 
(OCTOBER 1982 - AUGUST 1983 IMPACT SAMPLE) 
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only experimental showed quarterly earnings gains of $118 in quarters 2 
and 3, but thereafter the inoreases disappeared. This seems to reflect 
this group 1 s employment pattern, which declined sooner than that of the Job 
Search/BHBP sample. The drop was most pronounced foi the later group of 
Job Search applicants, as diaoussed below. ^ 

Table 3,? and Figure 3.3 show trends in welfare receipt and average 
welfare payments over an 18-month follow-up. The summary measures — "ever 
received a welfare payment" anJ "average total AFDC payments" — are 
disoussed first. As seen in the table, one notable finding is that a 
negligible reduction in welfare receipt for the Job Search/EHEP group was 
associated with a more pronounced and statistically significant reduction 
in welfare benefits ($288 — about an 8 percent reduction from the control 
group mean of $3*697) • This should not be surprising since AFDC grant 
calculation rules — especially over the first four months of employment 
when the income disregard is in effect — often result in grant reductions 
rather than terminations. (For AFDC 1 s, even a sanctioning penalty deducts 
only the part of the grant directed to the person sanctioned.) The overall 
$203 reduction in payments for the Job Search only experimentals was not 
statistically significant. 

Quarter-by-quarter, the table and figure show that the Job Search/EHEP 
program produced statistically significant grant reductions for as long as 
one year after welfare application, but that the impacts from the Job 
Search only program declined sooner; by the sixth quarter, there were no 
impacts at all. As seen in Figure 3.3, this reflects an earlier leveling 
off in the welfare payment reductions for this group compared to the Job 
Search/EHEP sample. Control group payments after quarter 2 also followed a 
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FIGURE 3.3 



AFDC APPLICANTS: 
TRENDS IN QUARTERLY AFDC PAYMENTS 
(OCTOBER 1982 - AUGUST 1983 IMPACT SAMPLE) 
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steady decline so that 18 months after welfare application, almost the same 
proportion of experimentals and controls — a little over one-third ~ were 
receiving welfare. 

Conf Inning the findings of the second report, these data on welfare 
reoeipt lead to the conclusion that deterrence — in the form of a 
participation requirement that might discourage persons from completing the 
welfare application process — was not an important effect of either of the 
San Diego approaches for the AFDC group. 8 As noted in Chapter 1 F in the 
design of the San Diego programs, county staff hoped that the job search 
requirement for applicants, as well as the EWEP work requirement, would 
deter a certain proportion of people from completing their applications. 
According to Table 3.2, the proportion of individuals who received welfare 
at some time during the follow-up period was virtually identical for the 
samples in both experimental programs and for the control group in the WIN 
Program. However, the data collected for this study do not address the 
broader question of whether the existence of the requirements deterred 
individuals from applying for welfare in the first place. 

The relationship between earnings gains and welfare savings is another 
important issue to address. This relationship is always complex, but the 
findings in this study of larger earnings gains than welfare savings 
suggest that the San Diego results were consistent with the rules and 
procedures for grant calculations and sanctioning during this period. 
Several faotors are relevant. First, under OBRA (which was in effect 
during most of the follow-up period), earnings do not reduce welfare grants 
on a dollar-for-dollar basis. (This was true in earlier periods as well.) 
For AFDC's, benefit levels are reduced by earnings only after child-care 
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and work-related expenses are deducted and, for a limited period of time, a 
♦30 plus 1/3 disregard on the remaining earnings, ' in a separate special 
study of welfare grant calculations, it was found that, on average, for 
those simultaneously reoeiving welfare benefits and earnings, an additional 
dollar of aarnings reduced the monthly grant amount by 56 cents. 10 

Seoond, the State of California has the second highest monthly payment 
standard in the country. During the period under study, the standard was 
♦526 for a family of three, and on July 1, 1984 this was increased to ^555. 
Thus, individuals in California can earn substantial amounts (or have 
unearned inoome such as Unemployment Insurance benefits) and still receive 
supplemental welfare payments. 11 Third, sanctioning does not remove all 
welfare assistance. For AFDC's, only the amount covering the needs of the 
person sanctioned is deducted from the family grant. (As Table 3.1 has 
indicated, sanctioning rates were considerably higher in the Job Search and 
the Job Searoh/EHEP programs than in the WIN Program with limited program 
services.) 

In addition, a lag is expected in adjusting welfare grants in response 
to any employment or sanctioning activity. Paperwork flow and the 
possibility that not all of the earnings gains will be reported to the 
welfare system or that the welfare system will inadequately record reported 
changes are potential problems. Therefore, welfare savings are not 
expected to parallel employment and earnings gains exactly. 

D. Imoaotg of the BWBP Add-On 

To test San Diego planners* belief that the addition of work experi- 
ence (tiWEP) fcfter Job search (EPP) would have an incremental effect on 
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participants 1 outcomes, the evaluation was designed to look at three 
possible ways in which EWBP could produce impacts. The work requirement 
could: 

• Deter people from ooopleting their welfare applications or 
change behavior in the Job search workshops. That is, people 
would leave welfare (and henoe leave or never participate in 
the program) to seek their own employment (or perhaps rejoin a 
spouse or remarry) in order to avoid the pending work 
requirement; or 

• Deter people at the point of EWBP referral or at some time 
during their participation in that program. Again, people 
would leave welfare either when they heard about the work 
requirement or after they began working because they disliked 
the job or the requirement- to work; or 

e Have its own effect: that is, the treatment — short-term work 
experience — could fulfill its stated intention of improving 
the skills, work habits and records of participants and, as 
such, serve as an employment and training activity that helped 
people to improve their labor market positions. 

One other possible EWEP effect could not be examined separately in this 

evaluation. Many have speculated that those holding Jobs for which wages 

are not reported to the welfare system — including "off the books w income 

not reported to the 01 system ~ would be "smoked out" by a participation 

obligation requiring substantial program activity. In other words, it 

would be impossible for these people to both participate (and thus collect 

welfare) and to work at the same time. To the extent that these jobs were 

already covered by the 01 system, employment and earnings levels will not 

change. 

This discussion begins by first comparing the outcomes for the two 
experimental programs to measure the incremental effects of the EWEP 
add-on. Table 3.3 shows the effects of the EWEP add-on for the full 
sample, indicating that, over the five-quarter follow-up period, EWEP 
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TABLE 3.3 



SAN DIBSO 

AFOC APPLICANTS: IMPACTS OF EWEP ADD-ON 
[OCTOBER 1962 - AUGUST 1883 IMPACT SAMPLE) 



UUlCuflB a no no I I OPT" up rBriOQ 


Job Seercn-EWEP 


I 

Job Seerch 


Difference 


C» * a ■» Cm ill ah ■ - M — » — n o / «y 1 ^ 

ever capioyeOf Quarters 2-6 [X] 


61.0 


60.5 


+0.5 


Average Number of Quarters With 








b 

Employnentf Quarters 2-6 


2.03 


1.88 


+0.15* 


Ever Employed (X) 








Quarter of Application 


35,5 


32.8 


+2.6 


Quarter 2 


35.6 


37.2 


-1.6 


Quarter 3 


40.2 


36.9 


+3.3* 


Querter 4 


42.4 


38.4 


+4.0** 


Quarter 5 


42.9 


37.8 


+5.0** 


Quarter 6 


41.9 


37.4 


+4.5** 


Avarage Total Earnings* 








Quarters 2-6 [$J 


3801.75 


3352.96 


+448.80** 


Average Total Earnings [$] 








Quarter of Application 


359.46 


367.66 


- 8.20 


Quarter 2 


508.51 


486.60 


+ 22.80 


Querter 3 


700.95 


656.04 


+ 44.92 


Quarter 4 


809.58 


668.88 


+140.69*** 


Quarter 5 


848.33 


742.42 


+105.81* 


Quarter 6 


833.39 


789.01 


+134.37** 


ever neceivea Any ArUL reyraentf 








uuarters i o i*j 


83.9 


85. 2 


-1.4 


Average Number of Months Receiving 








AFOC Payments* Charters 1-6 


8.13 


8.33 


-0.20 


tver Received Any AFOC Paynents [%) 








Querter of Application 


78.3 


78.5 


-1.2 


Quarter 2 


64.2 


66.2 


-2.0 


Querter 3 


51.8 


52.2 


-0.4 


Querter 4 


AC O 

45*8 


45.5 


+0.4 


Querter 5 


39.5 


42.3 


-2.8 


Diiknf an R 


dO m U 


36.2 


-1.2 


AvtriQA Total AFDC PavmnntB 

fWBI OyO 1 UMV r\* WW raj Mull *P 










»j •on qg 


iaqa nc 
o4o4.UO 


OA TO 

-B4.73 


Averege AFOC Payments Received ($) 








Quarter of Application 


733.60 


727.63 


+ 5.97 


Quarter 2 


695.38 


716.88 


-20.87 


Quarter 3 


581.94 


595.34 


-13.38 


Quarter 4 


512.91 


530.30 


-17.39 


Quarter 5 


462.06 


477.01 


-14.85 


Quarter 6 


422.81 


447.01 


-24.10 


Sample Size 


1502 


856 





ERIC 
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BtfEP end Job Seerch. 



See Table 3.2. Significance tests pertein to differences between Job Seerch- 
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produced an additional statistically significant earnings gain of $1*1*9 
compared to the Job Search program alone. This gain was largest in the 
last three quarters, where a statistically significant employment increase 
was also evident. In contrast, welfare savings from the EWEP add-on were 
small and not statistically significant — $85 over six quarters. 
Nevertheless, these savings were consistent and occurred in every quarter 
of follow-up after the application quarter. 

These overall effeota suggest that, on average, a program adding work 
experience after a -job search component is more effective than a program 
offering job search alone. This finding, however, is highly sensitive to 
the date of the application. As will be qualified in Section B below, the 
additional EWEP earnings gain was caused almost entirely by the behavior of 
the later group of applicants — those who applied for welfare after March 
1983* (Similar to the second report findings, adding EWEP did not increase 
program effectiveness for the early applicant group; for them, both San 
Diego models produced similar impacts.) The positive finding for the EWEP 
add-on rests on the relatively worse employment and earnings performance of 
the later Job Search only group compared to that of the later Job 
Search/EWEP group. The record of the later Job Search group is discussed 
in more detail below. 

It is important to interpret these data in the context of this 
report* s findings on possible deterrence, as raised in the hypotheses posed 
at the beginning of this section. A key conclusion of this and prior 
reports is that, contrary to the expectations of many, the presence of a 
work requirement in San Diego did not affect the behavior of individuals 
prior to or during the workshops. The impacts discussed above and in 
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Section E are more likely to hrve occurred because of deterrence at the 
point of BJEP referral (or within that program) or because of the work 
experience treatment itself. 

Several separate analyses support this conclusion. First, the second 
report found no evidence that deterrence occurred either right after 
welfare application or in the Job search workshops. This report confirms 
that, over a longer follow-up, almost identical proportions of both 
experimental groups received welfare; quantitative and qualitative data 
also show that the experience of both groups in the workshops was similar. 
(See Appendix Tables C.3 and C.4.) In addition, information collected in a 
six-month survey of a subsample of experimental s and controls suggested 
that less than two- thirds of the Job Search/EWEP group were aware of a work 
requirement, and most learned about it only through their workshop 
participation. 12 Even then, interviews with program staff found that the 
requirement was only emphasized toward the end of the workshops, near the 
point of EWEP referral. 1 3 

A special analysis was conducted to ensure that the incremental 
earnings effects for the EWEP add-on primarily reflected the behavior of 
only those referred to the activity and not the small numbers of people who 
were aware of the requirement during the workshops. In this analysis, the 
impacts of EWEP for workshop "completers" (i.e., those who finished the 
workshops without finding a Job) and for "noncompleters" or "others" (i.e., 
the nonregistrants, individuals never assigned to the workshops, no-shows 
and dropouts, as well as those who found Jobs while in the workshops), were 
calculated separately. 1 * There was very little EWEP effect on the 
"nonccmpleters" but fairly substantial employment effects on the Job search 



workshop completers, although this did vary according to application 
period. Appendix Table C.7 indicates that for completers (those most 
likely to be referred to work experience), EWE? increased the employment 
(10 percentage points) and earnings ($947) compared to the Job Search only 
group over the five-quarter follow-up period. These findings were less 
pronounced for the later applicants. 15 The welfare impacts were less 
clear-cut, but overall, the evidence appears to suggest that the EWEP 
add-on effects can be mostly attributed to ecapleters without a Job. The 
impacts most likely resulted from a change in behavior at the point of EWEP 
referral or during that program (i. e. 9 deterrence) or because work 
experience itself was a beneficial activity, helping participants in the 
labor market. Unfortunately, the two possibilities cannot be separated out 
in this evaluation. 

E. Impacts bv Applicat ion Period 

Evaluations of other welfare employment programs have suggested that 
program impacts may vary for saaples enrolled at different periods in time 
and may also differ depending on labor markets, characteristics of the 
research sample and program practices. Such is the case in this evalua- 
tion, where impacts seem strongly related to the period in which sample 
members applied for welfare. 

People applied for welfare during the early part of the demonstration 
— October 1982 through March 1983 — in the midst of a severe economic 
recession. Later applicants — the April through August 1 9 83 group — 
entered the sample at the beginning of an economic upturn. The unemploy- 
ment rate in San Diego peaked at 10.5 percent in January 1983» but by 
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August of that year, it had dropped to 8.2 percent. A year later, it had 
further declined to 6 percent, (See Figure 3.4.) The state of the economy 
thus determined, at least in part, who needed and applied for welfare and 
who entered the sample. Individuals applying in the later months appeared 
somewhat less "employable," as defined in terms of work history, oompared 
to those in the early sample. The more "employable" individuals who needed 
to apply for welfare in the early period probably would have been working, 
had labor market conditions been better. They most likely were working in 
the later period. (Sample characteristics are discussed in more detail in 
Chapter 2.) 

Tat, despite the lower employability of the later applicants, this 
group had one labor market advantage over the earlier applicants: a growing 
number of job opportunities, making it easier for them to find employment, 
even without program assistance. As indicated in Figure 3.5, the controls 
applying in the later period had slightly lower levels of employment and 
earnings in the quarters Just prior to welfare application than their 
earlier counterparts. But these later control applicants soon exceeded the 
employment levels of the earlier controls who had to Job hunt in a weaker 
economy. This pattern of differences was not as pronounced in the welfare 
statistics, however, as seen in Figure 3.6. 

Tables 3.4 and 3-5 and Figure 3.7 compare the outcomes of controls to 
experimentals in both application periods. The most striking finding is 
the large difference in earnings impacts for the Job Search group between 
application periods. Over the five-quarter follow-up period, the later 
applicants in the Job Search/EHEP group recorded a comfortable earnings 
gain — $623 compared to $719 for the earlier applicants — but the later 



ERLC 



-67- 118 



FIGURE 3.4 
TRENDS IN MONTHLY UNEMPLOYMENT RATE 
(JULY 1982 - MARCH 1985) 
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SOURCE: Bureau of Labor Statistics, Local Area Uoeiploynent Statistics 



FIGURE 3.5 

AFDC CONTROLS* QUARTERLY TRENDS IN EMPLOYMENT 
RATES ANO AVERAGE EARNINGS 
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FIGURE 3. 6 

AFDC CONTROLS! QUARTERLY TRENDS IN AFDC RECEIPT 
AND AVERAGE PAYMENTS 




Quarter Relative to Application 




SOURCE: See Tables 3.4 and 3.5. 
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TABLE 3.4 



APOC APPLICANTS! IMPACT 8 OF JOB 8EARCH-EVEP, BY APPLICATION PERIOD 
(OCTOBER 1862 - AU6U8T 1863 IMPACT SAMPLE) 





•Job Baaroh - EVEP 




October 


1682 - March 


1883 


1 

Apr! 1 


— Auguat 


1683 


Outcoao and Fol lot-Up Quartar 


Exparlaantal 


Control 


01 f f aranca 


Exparlaantal 


Co n t r o I 


Olffaranca 


Evar Eaployadi Quartara 














2-6 [*] 


60.2 


63.7 


♦ 8.6** 


82.1 


36.0 


♦ 4.1 


Evar Eaployadi Quartara 














e - 8 [«■ 


84.8 


80.7 


♦ 4.2* 


n/a 


n/a 


n/a 


Evar Eaployod [%) 














Quartar of Application 


88.6 


88.2 


♦ 0.4 


86.8 


88.0 


♦ 6.8* 


Quartar C 


82.6 


Q5.8 


♦ 7.0*** 


88.8 


83.8 


♦ 8.2** 


Quartar 8 


88*1 


28.8 


♦ 8.2*** 


43.1 


87.7 


♦ 6.8* 


Quartar 4 


41.4 


84.6 


♦ e.8*** 


43.8 


40.7 


♦ 3.2 


Quartar 6 


42.2 


36.4 


♦ b.b*** 


43.8 


40.8 


♦ 8.0 


Quartar 6 


86.6 


88.4 


♦ 8.2 


46.2 


40.8 


♦ 4.6 


Quartar 7 


40.4 


84.4 


♦ e.o** 


n/a 


n/a 


n/a 


Quartar 8 


86.6 


89. 3 


♦ 4.3* 


n/a 


n/a 


n/a 


Avaraga Total Earnlnga* 














Quartara 2-6 [•] 


8507.48 


27 88.81 


♦ 718. 88*** 


4218.74 


8608.02 


♦622.72* 


Avaraga Total Earning** 














Quartara 2-6 [I] 


6324.26 


4823.72 


♦1000.64** 


n/a 


n/a 


n/a 


Avaraga Total Eornlnga [•] 














Quartar of Application 


866.86 


846.28 


♦ 7.68 


862.65 


817.26 


♦ 46.88 


Quartar 2 


488.42 


801 .86 


♦ 131 .0»** 


616.57 


475.86 


♦142. 71** 


Quartar 8 


627 .41 


466*17 


♦ 171 .24*** 


806 .88 


868.1 0 


♦187 .68* 


Quartar 4 


746.87 


617.28 


♦ 128.08* 


888.48 


611 .27 


♦ 68.21 


Quartar 6 


882.82 


876.88 


♦166. 84** 


870.68 


812.60 


♦ 66.88 


Quartar 6 


868.87 


737 .61 


♦181 .86*- 


1024.12 


826.28 


♦1 85 .83** 


Quartar 7 


686.66 


737.66 


♦148.12* 


n/a 


n/a 


n/a 


Quartar 8 


887.08 


7 66.46 


♦187.65* 


n/a 


n/a 


n/a 


Evar Racalvad Any AFOC 














Payaantai Quartara 1 - 8 [%] 


83.8 


65.3 


- 1.7 


84.2 


82.7 


♦ 1.6 


Evar Raoolvad Any AFOC 














Payaanta f Quartara 1 - 8 [%] 


83,8 


88.1 


-2.2 
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n/a 


n/a 


Evar Racalvad Any AFOC 
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Quartar of Application 


76.8 


81.5 


- 4.8** 


80.4 


78.2 


♦ 2.2yy 


Quartar C 


64.7 


68.0 


- 4.3* 


83.6 


86.4 


- 1.8 


Quartar 8 


63.8 


68.7 


- 4.8* 


46.7 


52.2 


- 8.4 


Quartar4 


47.6 


48.6 


- 1.0 


43.4 


48.8 


- 3.4 


Quartar 5 


40,4 


41.8 


- 1.2 


38.1 


40.4 


- 2.8 


Quartar 6 


36.4 


87.0 


- 0.5 


32.8 


84.8 


- 2.0 


Qua r t a r 7 


38.6 


83.8 


♦ 0.2 


n/a 


n/a 


n/a 


Quartar 8 


30.2 


30.8 


- 0.7 


n/a 


n/a 


n/a 


Avaraga Total AFOC Payaanta 














Racalvad, Quartara 1 - C [•] 


84*3.01 


8721 .63 


-285.52* 


3388.61 


8668.03 


--288.62 


Avaraga Total AFOC Payaanta 
















4216.64 


4645.83 


-830.18 


n/a 


n/a 


n/a 


Avaraga AFOC Payaanta 














Raoalvad [•] 














Duirttp' <if Ann L ( et H on 


718.18 


738.16 


- 16.87 


754.81 


773.31 


- 18.38 


Quartar 2 


687.62 


784.80 


- 78.68** 


706.60 


788.42 


- 68.62 


Qua r t a r 8 


804.88 


686.42 


- 64.03* 


648.76 


828.82 


- 78.87* 


Quartar 4 


634.02 


583.28 


- 58.24* 


482.7 4 


657.78 


- 76.04* 


Quartar 6 


468.82 


611.66 


- 41.64 


460.30 


485 .14 


- 84.84 


Quartar 8 


420.68 


444.66 


- 88.86 


425.81 


446.77 


- 21.46 


Quartar 7 


402.67 


426.41 


- 28.64 


n/a 


n/a 


n/a 


Quartar 8 


888.21 


385.27 


- 26.07 


n/a 


n/a 


n/a 


Baapla Blza 


878 


635 




823 


83 8 
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TABLE 3.4 (continued) 



SOURCE i HDRC oclouiitloni froa County of 6m Oligo ailfiri ricordi ind Uniaployamt Iniunnci ricordi froa 
thi EPP Xnfocaitlon 6yitu. 

NOTE81 Thin diti Inoludi ziro vilun for uapli ■■■bin not laployid ind for uapli ■■■bin not 
fioilvlng itlfin. Thin diti in rierml on-idj uitid using ordlniry lint iquirn, oontrelllng for 
pri-ippM citl on chi rioti r 1 it 1 ci of uapli ■■■bin. Thin aiy bi iobi dl icnpmcl ■■ In silculitlng iuas ind 
dtffirinon dui to rounding. 



Quirtir 1t thi quirtir of ippl1oit1on» aiy ooMln ioai urnlngi froa thi pirlod prior to ippUcitton 
■ rd 1i thirifori ixoludid froa thi ainurii of totil fcuoi-up for laployaint ind urnlngi. 



A tao-tillid t-tut an ippllid to dlffirincn In lapicti bitaun ipplloitlon pirlodi. Gtitlitlcil 
■ Ignlftoinoi Livili in Indloitid m y ■ 10 pirointi yy ■ 5 pirointi yyy ■ 1 piroint. 



Only 18 aonthi of follow-up U iviHibli for thi Litir ippllointi. 



A tao-tillid t-tut an ippllid to dlffirinon bitinn ixpirlaintil ind oontrol groupi. Stitlitlcil 
■ Ignlfloinoi livili in Indloitid m • - 10 pirointi ■ 5 pirointi ■ 1 pircint. 
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TABLE 8.6 

AFOC APPLZCANTBl IMPACTS OF J OB BEAfCH, BY APPLICATION PERIOD 





(OCTOBER 


1882 - AU8U81 


1883 IMPACT 


SAMPLE] 








Job Starch 


Outcooe an* Follow-Up Quartar 


October 
Exparlaantal 


1882 - March 
Control 


1888 

01 f f aranco 


I 

April 
Exparlaantal 


- Auguat 
Control 


1868 

01 f f aranco 


Evar Eaployad, Quartara 
8 - B [*] 


i 

58.9 


53.7 


♦ 6.2** 


61.4 


56.0 


♦ 8.4 


Evar Eaployad* Uuartara 
C - B [I]' 


B5.8 


60.7 


♦ 5.3* 


n/a 


n/o 


n/a 


Evar Eaployad [X] 

Quartar of Application 

Quartar 8 

Quartar 8 

Quartar 4 

Quartar 6 

Quartar 6 

Quartar 7 

Quartar B 


82. B 
86. B 
86.8 
88.4 
87.8 
88.8 
86.4 
88.8 


88.2 
25.6 
28.8 
84.5 
86.4 
88.4 
84.4 
85.8 


- 0.7 
♦10.1 

♦ 8.0*** 

♦ 4.8* 

♦ 2.5 

♦ 2.9 

♦ 5.0* 

♦ 8.6 


88.7 
88.6 
86.6 
86.8 
87.8 
84.2 
n/a 
n/a 


88.0 
88.6 
87.7 
40.7 
40.8 
40.6 
n/a 
n/a 


v 0.7 
♦ 6.0* 

- it.fi y 

- 3. By 

- 3.0 

- 6.6*yy 
n/a 
n/a 


Avaraga Total Earnlnga* 
Quartara 2-6 [•] 


8606,04 


27 86.81 


♦817. 28*** 


2828.85 


3596.02 


-tt68.67*yyy 


Avaraga- Total Earnlnga, 
Quartara 2 - 6 [I] 


6486.46 


4828.72 


♦1114. 77** 


n/a 


n/a 


n/a 


Avaraga Total Earnlnga [•] 
Quartar of Application 
Quartar 2 
Quartar 8 
Quartar 4 
Quartar 6 
Quartar 6 
Quartar 7 
Quartar 6 


898.12 
601.61 
706.16 
718.78 
787.28 
865.27 
88? .21 
823 .73 


848.26 
801 .85 
456.17 
617.28 
876.88 
787.61 
787.65 
788.45 


♦ 48.84 

♦ 200. 25*** 

♦ 248.88"* 

♦ 88.48 

♦ 120.64 

♦ 147.68* 

♦ 1 85.68** 

♦ 184.28 


825.80 
460.77 
572.81 
587.61 
650.75 
654.81 
n/a 
n/a 


817.28 
475.86 
666.10 
811.27 
B12.B0 
826.26 
n/a 
n/a 


♦ 6.34 

- IB.OByy 

- 86.76yyy 
-228.66**yyy 
-161.78yy 
-17a.88yy 

n/a 
n/a 


Evar Racalvad Any AFOC 
Payaanta* Quartara 1 - 6 [I] 


86.2 


85.8 


- 0.1 


65.2 


82.7 


♦ 2.8 


Evar Racalvad Any AFOC 
Payaanta* Quartara 1 - B [%] 


85.7 


86.1 


- 0.8 


n/a 


n/a 


n/a 


Evar Racalvad Any AFOC 
Payaanta [I] 

Quartar of Application 

Quartar 2 

Quartar 8 

Quartar 4 

Quartar B 

Quartar 8 

Quartar 7 

Quartar 6 


78.8 
68.5 
62.5 
46.8 
42.8 
86.6 
88.1 
80.6 


81 .5 
86.0 
56.7 
48.6 
41 .6 
87.0 
83.8 
80.8 


- 1.7 

- 2.4 

- 8.2** 

- 2.8 
♦ 0.7 

- 0.2 

- 0.2 

- 0.2 


78.0 
65.6 
61 .6 
44.2 
42.8 
85.2 
n/a 
n/a 


78.2 
65.4 
52.2 
46.8 
40.4 
84.8 
n/a 
n/a 


♦ 0.8 

♦ 0.8 

- Q.6 

- 2.6 

♦ 1 .9 

♦ 0.8 
n/a 
n/a 


J *araga Total AFOC Payaanta 
Racalvad* Quartara 1-6 [Ij 


8588.18 


37 Li mZZ 


-182.86 


f421 .58 


S6£8.08 


-237.4* 


Avaraga Total AFOC Payaanta 
Raoalvad* Quartara 1 - 8 [I] 


4288.25 


4545.68 


-248.87 


n/a 


n/a 


n/a 


Avaraga AFOC Payaanta 
Racalvad [9] 

Quarter of Application 

Quartar 2 

Quartar 3 

Quartar 4 

Quartar B 

Quartar 6 

Quartar 7 

Quartar 8 


782.68 
714.65 
611 .82 
548*25 
468.58 
448.37 
896.60 
8 80.40 


738.1 C 
764.60 
866.42 
598.26 
511 .56 
444.55 
426.41 
885.27 


- 6.49 

- 50.06 

- 56.56 

- 44.01 

- 23.03 

- 2.16 

- 26.61 

- 14.67 


718.85 

7ie.es 

668.58 

489.24 
466.66 
455.30 
n/a 
n/a 


778.81 
766.42 
628.82 

557.76 
465.14 
446.77 
n/a 
n/a 


- 68.36 

- 46.60 

- 61.08 

- 58.53 

- 28 .48 
♦ 8.62 

n/a 
n/a 


Baapla 81za 


B8B 


585 




820 


836 
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SOURCE AND NOTE 6 1 8aa Tabla 8.4. 
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FIGURE 3.7 

AFDC APPLICANTS: TRENDS IN AVERAGE EARNINGS. 
BY APPLICATION PERIOD 
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SOURCE: See Tables 3.4 and 3.5. 
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Job Search only applicants had a very different experience. The earlier 
applicants' significant earnings gain of $817 completely disappeared in the 
later period, and the later Job Search applicants registered a 
statistically significant $670 loss in earnings. This later Job Search 
performance thus had a marked influence on the size of the overall average 
impacts for the Job Search program alone as a whole as veil as the EWEP 
add-on* (See Tables 3.2 and 3.3.) 

To measure the incremental effect of EWEP, Table 3 # 6 compares the 
outcomes of each experimental program to the other by application period. 
The table indicates that, for the early enrollees, the differences between 
the two programs were not statistically significant, although there were 
slight losses in earnings and small welfare savings for the EWEP add-on 
model. However, the variation in employment and particularly earnings 
between the two groups becomes dramatic in the later period as large and 
statistically significant differences develop. It is thus important to 
bear in mind that the EWEP earnings effects for the full sample (Table 3.3) 
have not been stable over time, and have stemmed from this later gain, 
although, as discussed above, the gain is particularly large because of the 
poor performance of the Job Search only group. 

There is no clear reason for the performance of the later Job Search 
group in the last half of the follow-up, particularly since welfare 
behavior did not change significantly from the earlier period* The key 
question is: Can the difference in earnings impacts between the two srmples 
in the different time periods be related to specific factors, such as 
changes in the labor market or program content of either the Job search 
wor'eshop or EWEP; or is the difference simply a statistical aberration? As 
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AFDC APPLICANTS] IHPACT8 OP EHEP ADD-ON. BY APPLICATION PERIOD 
(OCTOBER 1982 - AUBU8T 1983 INPACT 6AHPLE] 
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1 

October 1882 - March 1883 


April - Auguat 1883 




Job Search- 






Job Search 


- 




Outcon ind Folloi-Up Quarter 


EHEP 


Job Beerch 


Difference 


ENEP 


Job Search 


Dlf "erence 


Ever Employed, Quirtiri 














2 - 8 Hi' 


60,2 


58,6 


♦ 0.3 


82.1 


61.4 


+ 0.7 


Ever Eiployadi Quarters 














2 - 8 [%]* 


64,8 


65,8 


- 1.1 


n/a 


n/a 


n/a 


Ever Eiployid [X] 














Quarter of Application 


33,5 


32.5 


+ 1,0 


38.3 


33.7 


+ 4.7 


Quarter 2 


32.6 


35.8 


- 3.2 


3B.9 


39.6 


+ 0.2 


Quarter 8 


38.1 


36.9 


+ 1.2 


43.1 


36.8 


+ 6.2» 


Quarter 4 


41.4 


39.4 


♦ 2.0 


43.9 


36.8 


+ 7,0" 


Querter 8 


42.2 


37.9 


+ 4,3» 


43.9 


37.8 


+ 6.0* 


Quartet* 8 


30.8 


?9.3 


♦ 0.3 


45,2 


34.2 


+11.0 m yyy 


Quarter 7 


40.4 


31.4 


t 1.0 


n/e 


n/e 


n/a 


Quarter fl 


38,8 


■',8.8 


♦ 0,8 


n/a 


n/e 


n/a 


Average Totel Eerntngat 














Quartere 2-8(1] 


3507,49 


3806,04 


- 98.55 


4219,74 


2826.35 


+1282.38"»yyy 


Averega Totel Eernlngoi 














Quarters 2 - 8 [$] 


5324.26 


5438.4B 


- 114.22 


n/a 


n/e 


n/a 


Average Totel Eerninge [I] 














Quertar of Application 


356.66 


393,12 


- 38.16 


362.85 


325.60 


+ 37.05 


Querter 2 


432.42 


501.61 


- 69,19 


618.57 


480,77 


+ 157,79"yyy 


Quarter 3 


627.41 


705,16 


- 77,75 


805.68 


572.31 


♦ 233,37* M yyy 


Quarter 4 


746.37 


716.78 


♦ 29.59 


889.48 


587.61 


* 311.87* M yyy 


Quarter 5 


832.32 


797,23 


♦ 35.10 


670.88 


650,75 


+ 220,14" 


Quarter 6 


88B.97 ' 


885.27 


- 16.30 


1024.12 


654,81 


+ 3B9,21"*ysw r 


Querter 7 


885,88 


823,21 


- 37,54 


n/a 


n/e 


n/e 1* 


Querter 8 


827,08 


923,73 


♦ 3,36 


n/a 


n/e 


n/e 
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TABLE a, 6 (continued] 



I 



QutcoiB and Folloi-Up Quarter 


October 18B2 - Kerch 1883 


T 

\ 

April - August 1983 


Job 6eorch- 

CMCD 

tier 


Ink CakHok 

udo oeercn 


uii terence 


Job Search 

CM CD 

tier 


- 

jod oeercn 


Ulrrerence 


Ever Rfl ce 1 v • d Any AFDC 














Peyitmte, Quortere 1 - B [%] 


83.6 


86.2 


- 1,8 


64.2 


85.2 


- 1.0 


Ever Rtcitvtd Any AFDC 














Psyiantti Qutrttrs 1-8 [X] 


83.8 


65.7 


- 1.8 


n/a 


n/e 


n/e 


Ever Received Any AFDC 














Peyiente [%] 














Querter of Application 


76.8 


78.8 


- 3>0 


60.4 


78.0 


+ 1.4 


Querter & 


64.7 


66.5 


- 1.8 


83.5 


85.8 


- 2.3 


auerter 3 


S3. 8 


62.5 


+ 1.3 


46.7 


61.6 


- 2.8 


Quarter 4 


47.8 


48.3 


+ 1.2 


43.4 


44.2 


- 0,7 


Quarter 5 


Ah A 

4U.4 


AO 0 


■ 1 eb 


88.1 


4c .3 


- 4.2 


Quarter 6 


36.4 


36.8 


- 0.4 


3?.B 


36.2 


- 2.3 


f in, ■ k 7 

uuerter / 


33.6 


33.1 


♦ 0.4 


n/e 


n/e 


n/e 


Quarter S 


Qfl 0 
dUed 




_ A k 


n/a 


n/a 


n/a 


Averege Totel AFDC Peyiente 














Received, Quarter. 1 - 6 [t] 


3436.01 


3638.18 


-103.17 


3369.51 


3421.59 




Averege Totel AFDC Peyiente 














Received! Quarters 1 - 8 [$] 


4816.84 


4286.25 


- 80.82 


n/a 


n/a 


n/a 


Average AFDC Peyiente 














Received [$] 














Quarter of Application 


718.13 


732.86 


- 13.48 


754.81 


710.95 


+ 34.86 


Querter & 


BB7 B2 


714 65 


- PB.B3 

CO .9U 


706.50 


719 92 


- 13.32 

i u auc 


Querter 3 


604.38 


611.82 


- 7.44 


548.75 


568,58 


- 18.84 


Querter 4 


634.02 


548.25 


- 15.23 


482. 74 


488, c4 


- 18,51 


Quarter 6 


468.82 


488.53 


- 18.81 


450,30 


468.68 


- 8.39 


(Aunrtor o 


420.88 


442.37 


- 21.48 


425.31 


456.30 


- 28.88 


Quarter 7 


402.87 


888.60 


♦ 6.27 


n/a 


n/a 


n/a 


Quarter 8 


868.21 


380 . 40 


- 14.19 


n/a 


n/l 


n/a 


Seaplc 8lze 


87 B 636 


623 


320 
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Just noted, there is some evidence to suggest that the Job Search group did 
in fact perform poorly, and that there may have been an EWEP add-on effect 
during the later application period. The losses in earnings for the later 
Job Search group, however, may not be of the magnitude reported here, A 
few hypotheses can be posed to try to account for this group's behavior, 
but there is little hard evidence to inform them. 

One hypothesis is that there were either computational errors or 
errors in assembling the earnings data. Extensive review of the quality of 
the earnings records and related computational methods indicated that 
these f ladings were not the result of data errors. Appendix E presents a 
description of these data quality checks. 

Another hypothesis is that the program models and/or the program's 
operational performance changed substantially over this period. As 
discussed in the previous section, there is no evidence to support this; 
Appendix Tables C.3 and C,4 indicate no major differences in program 
activity levels for either research group or application period, and 
interviews with program staff suggest no operational changes of importance. 
Other hypotheses are more closely linkBd to the labor market. As 
noted above, labor market conditions changed, as did the applicants 1 
characteristics, over the demonstration period, 17 Later applicants had 
less of a work hisiory, but came into the sample and began Job search 
during a better economy than earlier applicants. Thus, one possibility is 
that Job search workshops may be less effective in strong labor markets 
than in weak ones. Previous studies, for example, have shown that group 
Job search moves individuals into entry-level, low- wage Jobs as a first 
step into the labor market and that these Jobs are similar to those usually 
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found without special assistance. However, in an improving labor market, 
people left to their own devices especially those with recent labor 
market experience — may have more effective ways of finding employment or 
methods that lead to better quality Jobs, If required to participate in a 
Job search program, they might forego these alternative methods and rely on 
the program to produoe Job opportunities. Thus, while both those in the 
workshops and those on their own find Jobs in good labor markets, the types 
of Jobs may differ. An analysis of earnings impacts for those with and 
without recent prior work history indicates that the largest loss in 
earnings and the largest reduction in quarters worked is experienced by 
those with a recent work history. (See Section H and Appendix Table C. 11.) 

A related hypothesis deals with Job loss. The data were carefully 
examined to determine if the later Job Search and Job Search/EWEP appli- 
cants, once employed, appeared to remain so. For both groups, the main 
employment surge took place in quarter 2, but the later Job Search group 
did not hold their Jobs to the same extent as their Job Search/EWEP counter- 
parts. Appendix Table C.8 shows that the majority of applicants who ever 
worked during follow-up had Jobs by the quarter after application. Both 
programs resulted in substantial and statistically significant increases in 
the proportion holding Jobs in quarter 2 but virtually no effect on finding 
Jobs after that quarter. As seen in Appendix Table C.9, the later Job 
Search group experienced more Job losses between quarters 2 and 6 than 
controls (by a statistically significant 11 percentage points), while the 
later Job Search/EWEP group 1 s Job loss compared to controls was only a 
nonsignificant 3 percentage points. Therefore, some part of the poorer 
earnings performance of the later Job Search group is due to their greater 



job loss and subsequent tendency to stay out of the labor market: those 
employed in quarter 2 show a higher propensity to be unemployed in quarter 
6. Purther, there was also a slight but not statistically significant 
increase in the proportion of those returning to the welfare rolls among 
the later Job Search group, as seen in Appendix Table C.15. 

Anothcir possible explanation is that, in better labor markets, work 
experience of the short-term type offered by BJEP is particularly helpful 
for applicants with a poor work record. In fact, there may be a 
complicated interaction between good labor markets and an inexperienced 
welfare population that can explain why additional program assistance, 
beyond job search instruction and support, is needed for some people to 
make demonstrable gains in the labor market. 

- Any of the possibilities seem reasonable and in fact it may have been 
several working together, along with random chance and other factors, that 
combined to produce this large difference in earnings effects across 
application periods for the Job Search group. 

F. Do Impacts Decline or Increase Over Time? 

This section will draw together the various impact trends, both those 
for the full sample and those by application period, to focus on the 
consistency and stability of the observed impacts. To examine how these 
impacts might; hold up over time, two additional quarters of data were 
analyzed for an early applicant group those applying during the October 
1982 through ithe March 1983 period. (See Figure 3.8.) These data will be 
referred to when appropriate. 

Data for the full sample (Table 3.2) suggest that the Job Search/EWEP 
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FIGURE 3.8 
AFDC APPLICANTS: TRENDS 
IN QUARTERLY EMPLOYMENT RATES AND AVERAGE AFDC PAYMENTS 
(OCTOBER 1982 - MARCH 1983 IMPACT SAMPLE) 
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employment and earnings in acts were fairly stable throughout the demonstra- 
tion period, but that this was not true for the Job Search group, whose 
overall trend was strongly influenced by the experience of the later 
applicant group. For both program models, there were notable welfare 
reductions during the year after welfare application, but thereafter the 
welfare reductions became nailer, particularly for the Job Search group. 

When the impacts are observed in more detail, quarter-by-quarter, it 
is dear that employment and earnings gains for the Job Search/EWEP group 
persisted and were . statistically significant over the five quarters of 
follcw-up, with some drop after quarter 3, By quarter 6, the employment 
rate was higher than controls by 4 percentage points and the earnings had 
risen tjy $161. Despite some differences between the early and later Job 
Searoh/HJBP groups, Table 3.4 and Figure 3.8 show that similar levels of 
impacts continued for an additional two quarters of follow-up. 

In contrast, Job Search alone produced large and statistically signifi- 
cant improvements in employment and earnings only in the first two quarters 
of follow-up; after these quarters, there was a marked decline in ,both 
measures. By the sixth quarter of follow-up, there was no employment 
impact and the earnings difference had stabilized at a low level — $2? per 
experimental — a figure that is not statistically significant. 

An examination of the Job Search group shows the diversity by applica- 
tion period. For the early group of applicants — the focus of the second 
report ~ there were positive employment and earnings improvements for as 
long as seven quarters after application, although the gains became some- 
what lower in the later quarters. During the eighth quarter, there was a 
3.5 percentage point increase in the proportion working, and an earnings 
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gain of $134, although neither was statistically significant. (Table 3.5 
and Figure 3.8, ) In contrast, the later group of Job Search applicants 
experienced net losses in earnings which, although not statistically 
significant, did continue through the sixth quarter, despite the initial 
increase in the proportion of later applicants working. The Job Search 
impact trend Is thus very sensitive to the timing of application and not at 
all stable, although, as seen in Table 3.5, employment impacts in the 
additional two quarters of follow-up seemed to be steadier for the early 
sample. 

As noted previously, welfare savings in both programs were modest but 
reached their highest points in quarters 2, 3 and 4. The impacts 
thereafter stabilized at a low level. There is some suggestion in the 
eight-quarter follow-up of the early applicant sample that small welfare 
reductions may continue to occur for both program models. In support of 
these findings, Table 3.2 shows that, in quarters 2 through i| 9 Job 
Search/EWEP payments declined by between $67 and $72, while the Job Search 
only reductions were slightly lower. The reductions were nevertheless 
statistically significant until quarter 5 when the impacts became smaller 
and, for the Job Search group, disappeared. Figure 3.8, however, shows 
that over the longer follow-up for the early sample, small and not 
statistically significant welfare reductions continued for both programs. 
The timing of the welfare application did not appear to affect the welfare 
receipt ard payments of either group. 

To obtain an additional reading on longer-term impacts, earnings gains 
and welfare reductions were estimated for the combined last two quarters of 
data available ;*or each application period. For the earliest applicants 
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(October 1982 through December 1982), these were quarters 8 and 9, counting 
from the quarter of random assignment; for those applying in July and 
August 1983, quarters 5 and 6 only. Despite the difference in the relative 
quarters used for each individual, these estimates have the advantage of 
using the full sample and the last available follow-up data. Estimates for 
these final quarters (in unadjusted form) have been used in the 
benefit-cost analysis (Chapter 5) as the base from which to project total 
earnings gains and welfare savings up to five years following random 
assignment. 

The adjusted control group average of earnings for the last two 
follow-up quarters is $1,592. From this baseline, gains of $289 and $74 
were experienced, respectively, by the Job Search/EWEP and Job Search 
groups, with only the former statistically significant. The corresponding 
welfare reductions were $44 and $15 (neither statistically significant) on 
a control group AFDC payment base of $829 for the last two quarters 
combined. 

G. Impacts on Other In come Sources 

The previous discussion has addressed the San Diego programs' effects 
on two important sources of income for sample members: welfare receipt and 
the applicants 9 own earnings. However, as indicated in the second report, 
applicants may be beneficiaries of other cash and in-kind income which they 
themselves my receive, or which immediate family members or other indivi- 
duals living either in or outside of their households may receive. 1 8 
Except for Unemployment Insurance compensation, information on other income 
sources is available from a survey conducted by MDRC with a random sub- 
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sample of experimental s and controls six months after welfare application. 

Some survey results were included in the second report, but at that time, 

administrative records data on 01 benefits were not available for the full 
sample, 1 9 

The survey data confirmed that welfare receipt an* applicants' 
earnings were the most important income sources for both the applicants and 
their families, accounting for more than three-quarters of all income 
reported by the applicants and 70 percent of all family income. The data 
also show that Food Stamps and Unemployment Insurance compensation were the 
next most important sources, at least during the sixth month after appli- 
cation. 

With administrative records on 01 benefits now available for the fail 
sample for at least 18 months, this section reports on two issues: the 
extent to which the San Diego programs affected receipt of 01 compensation, 
and — using welfare, earnings and benefits data — program impacts on 
measured income. 

1. Onemplovment Insurance Benefits 

During the quarter of application, almost one-quarter of the AFDC 
applicants — both experimental and controls — received some Onemployment 
Insurance compensation, but by the sixth quarter only 5 to 6 percent did 
so. (See Tfcble 3-70 Generally, neither program affected this pattern nor 
the size of the payments throughout the follow-up period, although there 
were small and positive but not statistically significant increases in the 
level of benefits paid to the Job Search group ($67 over 18 months). This 
was due to the later Job Search applicants, who received slightly more over 
the 18 months ($97) than the earlier group ($38), as indicated in Appendix 
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Table C.10. Other than this, early and later applicants exhibited fairly 
similar patterns of 01 receipt. 
2. Measured Tnf*9 B? 

To obtain a measure of total income that included the three major 
income sources — welfare payments, earnings and 01 benefits information 
from monthly APDC and 01 benefits reoords were aggregated into three-month 
calendar quarters to mate* the 01 earnings quarterly periods. Table 3*8 
indioates that the Job Search/EHEP sequence improved total income by the 
statistically significant amount of $464 over the five-quarter follow-up. 
The increase for the Job Search program was lower and not statistically 
significant ($159). 

The greater improvement for the Job Searoh/EWEP group reflects in part 
this group's smaller reductions in welfare payments relative to their 
larger earnings increases (as compared to the Job Search group). The Job 
Searoh group's small increase in 01 benefits helped these experimental s to 
offset reductions in welfare payments. However, as discussed previously, 
these findings mask differences in employment and welfare patterns between 
the early and later applicants. For example, the gain in measured income 
for the earlier group of applicants from both programs was substantial and 
statistically significant ($468 for the Job Search/EWEP group and $676 for 
the Job Searoh only experimental s) . For the later group there was a 
statistically significant loss in measured income for the Job Search group 
and small but not statistically significant inoreases for the Job Search/ 
EHEP group. (See Appendix Table C.12.) 

The bottom panel of Table 3.8 also shows the composition of the total 
sample by sources of income — i.e., income status — as of quarter 6. 
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SAN DIEGO 

AFOC APPLICANTS I IMPACTS OT JOB 6EARCH-EWEP ANO JOB SEARCH ON MEASURED INCOME 
(OCTOBER 1882 - AU8U8T 1883 IMPACT 8AMPLE] 

r 1 





Job 


Booroh - EWEP 




Job Boorch 


Outcooo and Status 


Export aatital 


Control 


01 f f oronco 


Export oontol 


Control 


01 f f oronoo 


Avaraga Total Inoooo 
Raoatvad, Quortoro 2-8 ($]" 


6882.60 


8618.68 


♦464. 01** 


6677 . 1 2 


661 6.68 


♦166.68 


Avaraga Totol Inoooo 
Raoalvad (•) 

Quartar of Appllootlon 

Quortor 2 

Quarta. 8 

Quartar 4 

Quartar 5 

Quartar B 


0 

1408.86 
1408.68 
1408.06 
1862.84 
1888.27 


0 

1828.88 
1818.20 
1888.77 
1280.88 
1267.84 


0 

♦ 78.86" 

♦ 86.40** 

♦ 64.28 

♦ 81.46 
♦141. 82** 


0 

1424.86 

* a on ft a 
1 980 .98 

1288.76 

1276.86 

4 nn o rb 

1 SUC iBD 


0 

1826.88 

4 94 9 Ofl 

1838.77 
1280.68 

4 OR 7 9 A 


0 

♦ 66.66" 

▼ Of m 1 a 

- 60.00 

- 1 .04 

♦ 45.22 


Statua During Quartar 6 [*] b 














No aarnlnga* AFOC Poy o on t o 
or UI Banaflta 


81.0 


88.1 


- 2.1 


82.4 


88. 1 


- 0.7 


No aarnlnga» ond oooo AFOC 
Poyoonto or UI Bonoflto 


27.0 


28.1 


- 2.1 


80.1 


28.1 


♦ 1.0 


Booo aarnlnga» AFOC 
Poyoonto or UI Bonoflto 


12.1 


12.6 


- 0.6 


18.0 


12.6 


♦ 0.4 


8ooo oornlngo» no AFOC 
Poyoonto or UI Bonoflto 


80.0 


26.2 


♦ 4.6 


24.6 


26.2 


- D.7 


8ooplo 61zr 


1602 


878 




066 


878 





SOURCE! MDRC ooloulotlono froo County of Bon DIobo oolforo rooordo ond Unooployoont Inouronoo oornlngo 
rcoorde froo tho EPP Information Syotoo ond Unooployoont Inouronoo bonoflto rocordo froo tha Btoto of 
Calif ornlo. 

NOTEBt Maaaurad Incooo lo doflnod oo totol oornlngo* oalfara poyoonto* tfnd unooployoont cooponootlon 
rooolvod during o oolondor quortor. 

Thooo doto Inoludo zoro voluoo for oooplo oooboro not ooployod ond for oooplo oooboro not 
rooolvlng oolforo or UI bonoflto. Thooo doto oro rogroool on-adj uo tod uolng ordlnory looot aquaraai controlling 
for pra-appl I ootl on ohoroctorl otl co of oooplo oooboro. Thoro aay ba aooo dl ocroponol oo In calculating auaa and 
dlffarancaa dua to rounding. 

*Mooourod Incooo lo not ovolloblo for tho quortor of oppllootlon baoouoo only Indlvlduolo oho 
oppllod for AFDC during tho flrot oonth of tho oolondor quortor hovo Inforootlon about oolforo payaanta for tho 
full throo aontho of thot quortor. 

b 

Tho oolculotlono for Btotuo during Quortor 6 hovo not boon ragraaalon-odj uotodi tooto of 
ototlotlool algnlfloonoo hava not boon oppllod. 

A too-tollod t-taat ooo appllad to dlfforoncoo bosooen axparlaantal and control group*- 
Stotlotlcol algnlfloonoo lovolo oro Indlootod aai • ■ 10 parcantj * 6 parcanti ■ 1 parcant. 




Generally, the San Diego programs did not result in major changes in the 
use of various income sources although there was an increase in the 
proportion of applicants recording earnings. This suggests impacts reflect 
mostly changes in the level of these income sources, not types. In quarter 
6, approximately one- third of experimental s and controls recorded no 
earnings, welfare payments or UI benefits. To examine this further, the 
six-month survey data were used to look for other sources of income or 
contributions by immediate family members or others inside or outside of 
the household. There was little evidence that these sources were 
important, except for a small and not statistically significant increase in 
contributions to the Job Search group from individuals other than 
applicants. One explanation may be remarriage or earnings not reported to 
the UI system. 

Table 3.8 indicates that between 25 and 30 percent of the full sample 
were found to have only earnings; this group received no welfare or UI 
payments at any time during the sixth quarter. The remainder received both 
welfare and UI benefits, possibly in combination with earnings, at some 
point during this quarter. This is not surprising given California's high 
welfare payment standard that allows seme lower earners to collect welfare 
even though they have income from other sources. 

H. For Which flroupa Do The Progra ms Work Beat? 

This section presents subgroup analyses to address the question: For 
which groups of applicants does job search or job search combined with work 
experience have the largest impacts? Impacts are estimated separately for 
individuals with differences in work history, prior AFDC dependency and 
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family size (that is, if they have one or more children), 20 In each case, 
the full sample has been subdivided to obtain sufficient sample sizes. 
Differences uy application periods, discussed previously, are not 
explicitly analyzed, except for the work history subgroups. 
1. Impaota bv Prior Work History 

Because previous evaluations, 21 including the second report, have 
suggested that employment and training programs have their largest impacts 
on individuals with little or no recent employment experience, this 
analysis is a particularly important one to understand. The finding as a 
rule does not mean that very hard-to-employ gro^? Achieve high levels of 
post program employment. On the contrary, absolve rates of employment are 
generally much higher for more job-ready Individuals. However, because 
welfare receipt is only a temporary source of aid for many, 22 a substantial 
number of people leave the rolls on their own within a short time, without 
any assistance. Thus, programs that work with people who would have found 
jobs by themselves or cycled off welfare for other reasons may appear 
successful when in fact they have not made a large difference; employment 
rates would have been high in any case. In contrast, programs helping 
those who would have done poorly on their own may look less successful 
because of the low absolute levels of employment, but they may have caused 
a greater change in behavior. 

Thus, as shown in Figure 3.9 and Table 3*9i the Job Searoh/EWEP 
experimental with no work record in the year prior to random assignment 
experienced an almost 10 percentage point employment gain through quarter 6 
find the earnings improvement was $1,066. Compared to controls with no 
reoent prior employment, this is a 72 percent increase in earnings; it is 
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FIGURE 3.9 

AFDC APPLICANTS: AVERAGE EARNINGS AND AFDC 
PAYMENTS: BY PRIOR YEAR EMPLOYMENT STATUS 
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3 » 

NOTE: Earnings are averaged over quarters 2-6. AFDC Payments are 
averaged over quarters 1 ■ 6. 
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three times as great as the impacts for those with a recent work history. 
These figures are in marked oontrast to a 1.8 percentage point increase an 
employment and an earnings gain of $3*8 for those with some work history in 
the prior year. Job Searoh/EWEP experimental who had held a Job previous- 
ly experienced only a 7 peroent earnings gain compared to their control 
counterparts, although earnings levels were three times those of 
individuals without prior work experience, bearing out the finding 
explained above. 

Similar results were seen for the Job Search only group. Those with 
no recent prior employment had larger employment (7 percentage points) and 
earnings gains ($641) in quarters 2 through 6 00m pared to those who had 
worked recently (3 percentage points and a loss of earnings of $122). This 
suggests an important finding: that the relatively poor performance of the 
later Job Search group, especially during the later application period, was 
in large part due to the behavior of those with prior work history. 

None of the gains in employment and earnings for either experimental 
group resulted in any consistent statistically significant welfare impacts 
that could be tied to applicants 1 work history. As indicated in Table 3.9, 
the group with no recent employment had somewhat lower welfare savings over 
the follow-up period than the group with prior employment, despite this 
former group's larger earnings gains. However, there is some indication 
that, by the last quarter of the follow-up, welfare savings were larger for 
those with no recent work history, but only for the Job Searoh/EHEP group. 

The impacts on subgroups identified by recent work history appear 
particularly sensitive to the timing of welfare application within the Job 
Searoh group. For the early applicants, those with no recent work history 
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registered earnings gains of $1,228 over five quarters; during the later 
period, their small losses were not statistically significant, (See Table 
C.11.) In contrast, the early applicants with some Job history had 
earnings gains of $389 that were not statistically significant, but their 
later counterparts sustained a large and statistically significant loss of 
41,060. While both those with and without reoent work experience among Ihe 
later applicant group had lower earnings impaota, the large losses for 
those with a reoent work history are notable. Welfare impacts were similar 
across the two application periods for individuals in both subgroups. 

These results confirm those of the second report, in which it was seen 
that the San Diego Job Search and Job Search/EWEP programs had a generally 
greater earnings impact on applicants who were hard-to-employ, as character- 
ized by the lack of reoent employment prior to welfare application. 

2. Impacts bv Prior A1?nC Dependency 

Impacts were also estimated separately for applicants who had never 
received welfare, had received it for two years or less, or had received it 
for more than two years, all prior to this recent application for welfare. 
This analysis provides insight into how the programs affected individuals 
who had recently undergone a financial change in their lives (such as job 
loss) and had applied for welfare, perhaps for the first time, compared to 
those who might be more entrenched in the welfare system. 

In general, impacts were larger for AFHC's who had received some 
welfare prior to application than those who had not. (See Figure 3,10 and 
Appendix Table C.13.) Regardless of prior welfare receipt, the employment, 
earnings and welfare impacts were generally larger end more frequently 
statistically significant for the Job Search/EWEP experimental s than for 
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FIGURE 3. 10 

afdc applicants: average earnings and afdc 
payments! by prior year afoc status 
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SOURCE: See Table C. 13 

NOTE: Earnings are averaged over quarters 2-6. AFDC Payments are 
averaged over quarters 1-6. 
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the Job Search group. 

3. Impacts of Job Search bv Number of Children 

Program effects on families with one ohild were compared to those for 
families with more than one ohild. Earnings and welfare savings were 
greater and mostly statistically significant for families with two 
ohildren or more. This probably refleots the fact that individuals with 
larger families reoeive higher grant payments, and thus, there is a greater 
potential for welfare grant reductions among this group. (See Appendix 
Table C.14.) 
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CHAPTER 4 

AFDC-U APPLICANTS: EMPLOYMENT. EARNINGS AND welfare TflP fl p T p 



This chapter presents the Impacts of the two San Diego models for the 
AFDC-U applicant group « mostly male heads of two-parent households. 
Similar to Chapter 3, impact findings for the full sample are discussed 
first, followed by impacts by period of welfare application and other 
important subgroup distinctions, 

A. Experimental-Contro l Treatment Differences 

As for the AFDC group, Table 4.1 shows that there were statistically 
significant and large differences in program treatment between the two 
experimental and control groups, as well as between each of the two program 
models. Within a six-month follow-up period, close to one- half of the 
experimental applicants had participated in some structured activity, but 
only 3.5 percent of the control group members had done so. As noted in 
Chapters 2 and 3, those randomly designated as controls were required to 
register with the regular WIN Program. The main activity for experimentals 
was group Job search, taught in workshops, followed by, for the Job 
Search/EWEP group, a work experience position in a public or nonprofit 
agency. (Controls, if served, generally received individual Job search, a 
far less intensive activity.) Fifteen percent of all AFDC-D applicants in 
the Job Search/EWEP experimental group spent at least one hour in a work 
experience Job. 

Another principal difference between the groups was the level of 
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sanctioning. Rates for the two experimental groups were considerably 
higher than the control rate (4 to 5 percent compared to less than 1 
percent), reflecting the low level of services available to WIN 
registrants. By the ninth month after application, the sanctioning level 
for the Job Search/EWEP group had gone up to 6.3 percent. (See Appendix 
Table c.1.) 

Also by the ninth month after application, only between 5*5 and 6.2 
peroent of the Job Search only and Job Search/EWEP registrants remained in 
the program but were unserved by program staff, while 16.6 percent of the 
control registrants had not been reached. (See Table C.2 and the discus- 
sion in Chapter 3.) These rates, also slightly lower than those of the 
AFDC's, indicate that very few AFDC-U applicants stayed continuously 
enrolled in the program without fulfilling the requirements. Those who 
did, as a special case file review revealed, were primarily registrants who 
had been officially deferred or exempted from participation. These data, 
as well as other information presented in the second report, strongly 
suggest that San Diego did in fact implement a mandatory job search and 
work requirement for the AFDC-0 as well as the AFDC applicants. 

B. Impacts on Employment, Earnings and Welfare 

As seen in the second report, the impacts over the six-month follow-up 
reflected mainly the effects of the job search treatment since many Job 
Search/EWEP experimental were still in work experience positions at the 
end of this period. In contrast to the AFDC findings, however, there were 
substantial reductions in welfare payments among APDC-D f s. The longer-term 
follow-up of the early sample showed particularly large savings for those 
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in the Job Search/EMEp model. There were also smaller employment 
increases. While both programs led to statistically significant six-month 
employment gains, there was no promise of sustained impacts on either 
employment or earnings in the longer follow-up. In addition, similar to 
the AFDC'8, the AFDC-0's did not show changed behavior due to BWEP, 
although it was still too early to measure EWEP's effects reliably. 

As explained in Chapter 2, individuals applied for welfare over an 
extended period of time — 11 months beginning in October 1982. Thus, 
overall impacts for the full sample — which express the average change in 
behavior for a variety of individuals over time — can aask important 
diversity, as for the AFDC group. There were, in fact, some differences in 
characteristics between AFDC-D's applying early in the demonstration as 
compared to those applying later, as well as some small differences in 
program outcomes. Nevertheless, the AFDC-U sample, regardless of 
application period, was on the whole a quite employable group, with over 
two- thirds having a Job record in the year prior to welfare application. 
The impact differences between the early and later applicants were also not 
as pronounced as those for the AFDC's. The average impacts for the full 
AFDC-U sample are thus fairly representative of the programs' effects on 
this group throughout the demonstration. 

The principal findings of this report show that the early six-month 
Improvements in employment and earnings were not sustained f^r members in 
either experimental group (as predicted in the second report's yearlong 
follow-up for the early sample). In this report, after a year and 
one-half, the full sample experienced virtually no employment or earnings 
-gains. However* there were large and statistically significant welfare 
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savings for both program models. 

Table 4.2 shows that, during the full five-quarter follow-up in this 
report, 76.3 percent of the Job Search/EWEP experimentals and 74. 0 percent 
of the Job Search only experimentals worked as compared to 73,6 percent of 
the controls. (These small differences are not statistically significant.) 
Except for the quarter after random assignment (in which a 5 to 6 percent- 
age point gain in employment occurred), employment impacts were erratic and 
not statistically significant. Overall, earnings improved by $384 and $216 
for the Job Search and Job Search/EHEP groups, with the largest gains 
taking place in quarters 2 and 3. By the final follow-up quarter, however, 
the impacts were essentially zero. This pattern reflects not so much a 
poor record on the part of AFDC-0 experimentals but rather that controls 
quickly caught up to the experimentals' levels. Even in the absence of 
special services, more than one- half of the AFDC-U control group were 
employed by quarter 4. (See Figure 4.1.) 

Table 4.2 and Figure 4.2 show trends in welfare receipt and average 
welfare payments over the 18-month follow-up period. Over this period, 
similar proportions of Job Search/EWEP experimentals and controls at some 
point received welfare payments, while welfare receipt among the Job Search 
applicants declined from the control level by a statistically significant 
3.5 percentage points. This suggests that the Job Search program may have 
deterred some members of this group from going on welfare. 

A review of welfare receipt quarter-by-quarter shows that reductions 
in the proportion receiving some welfare peaked for the Job Search/EWEP 
group in the third quarter, when the drop was a statistically significant 
7.4 percentage points. Thereafter, reductions slowed to about 3 percentage 
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TABLE 4.2 



SAN 0IE60 

AFOC-U APPLICANTS! IMPACTS OF JOB 8EARCH-EMEP AND JOB SEARCH 
(OCTOBER 1882 - AUGUST 1883 IMPACT SAMPLE] 



t r 





Job 


Baarch - 


EHEP 


Job Baarch 


Outcoaa and Folloa-Up Quartar 


Exparlaantala 


Control a 01 ffaranoa 


Exparlaantal a 


Control a 


01 f f aranca 


Evar Eaployad» Quartara 
» - a [I]' 


76.3 


73.6 


♦ 2.7 


74.0 


73.6 


♦ 0.4 


Avaraga Nuabar of Quartara 
■1th Eaployaanti Quartara 
2-8* 


2.68 


2.50 


♦ 0.07 


2.54 


2.50 


♦ 0.04 


Evar Eaployad II] 

Quartar of Application 

Quartar 2 

Quartar 3 

Quartar 4 

Quartar 5 

Quartar 6 


60.2 
48.2 
SO. 6 
68.3 
54.4 
5S.2 


48.6 
40.7 
48.8 
53.7 
52.1 
55.3 


♦ 1.6 

♦ 6.6** 

♦ 2.0 

- 0.4 

♦ 2.3 

- 2.2 


48.3 
45.8 
47.8 
52.4 
54.3 
53.8 


48.6 
40.7 
48.6 
53.7 
52.1 
55.3 


♦ 0.7 

♦ 6.2** 

- 0.8 

- 1.3 

♦ 2.1 

- 1.6 


Avaraga Total Earnlngai 
Quartara 2-6 [I] 


7360.64 


7144,88 


215.87 


7528.56 


7144.88 


4383.68 


Avraga Total Earnlnga [•] 
Quartar nf Application 
Quartar 2 
Quartar a 
Quartar 4 
Quartar 6 
Quartar 6 


762.87 
848.82 
1288.86 
1667.06 
1731.56. 
1 629. 37 


747 ,48 
824.27 
1224.67 
1600.65 
1873.32 
1822.08 


♦ 15.48 

♦ 124.35* 

♦ 88.38 
- 43.68 
+ 68.24 
+ 7.28 


816.86 
873.72 
1360.53 
1848.53 
1708.08 
1836.70 


747.48 
824.27 
1224.67 
1600.86 
1874..&2 ■ 
1822.08 


« 88.48 
♦148. 46** 
♦136.88 * 
+48.88 

♦ 34.76 

♦ 14.62 


Evar Racalvad Any AFOC 
Payaantai Quartara 1 - 6 It] 


82.3 


83.1 


-0.7 


78.6 


83.1 


-3.6* 


Avaraga Nuabar of Montha 
Racalvlng AFOC Payaantai 
Quartara 1-6 


8.68 


7.61 


-0.82*** 


6.88 


7.61 


-0.83*** 


Evar Racalvad Any AFOC 
Payaanta [X] 

Quartar of Application 

Quartar 2 

Quartar 3 

Quartar 4 

Quartar 6 

Quartar 6 


75.8 
65.4 
42.7 
86.0 
32.7 
30.2 


77.3 
62.0 
50.1 
41.7 
36.6 
33.1 


-1 .5 

-e.e*** 

-7.4*** 
-6.7*** 
-3.8* 
-2.8 


76.0 
55.4 
43.2 
38.0 
32.5 
28.0 


77.3 
62.0 
60.1 
41 .7 
36.6 
33.1 


-2.4 

-6.6*** 

-7.0*** 

-2.7 

-4.0* 

-6.1** 


Avaraga Total AFOC Payaanta 
Raoalvadi Quartara 1-6 [I] 


8123.70 


3653.28 


-628. 68*** ; 


8183.60 


3663.28 


-488.68*** 


Avaraga AFOC Payaanta 
Racalvad [•] 

Quartar of Application 

Quartar 2 

Quartar 3 

Quartar 4 

Quartar 6 

Quartar 6 


701 .01 
618.68 
508.58 
46C71 
428.88 
405.48 


733.23 
738.24 
840.38 
550.78 
518.11 
470.52 


- 82.22 
-120. 26*** : 
-130. 80*** 

- 81 .OB*** 

- 80. 16*** : 

- 66. 08** 


685.67 
684.00 
521 .81 
500.34 
446.14 
885.54 


733.23 
738.24 
840.3 8 
550.78 
518.11 
470.62 


-37.68 
-106. 24*** 
-118. 47*** 
-50.45 
-72. 97** 
-84.88** 


8aapla 8lza 


1878 


618 




831 


813 





tcontlnuod) 
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TABLE 4.2 (continued) 



SOURCE i NORC calculations froa County of Son Olago aolforo rocordo ond Unoaployaont Inouronco oernlnge 
rooordo froa tho EPP Xnforaotlon Syataa. 

NDTE81 Thooo doto Includo tiro voluoo for ooaplo aoaboro not oaployod ond for ooaplo aoaboro not 
roeolvlng aolforo. Thooo doto oro rogroool on-odj uotod uolng ordlnory looot oquorooi controlling for 
pra-appll cation ohorocto r 1 otl 00 of ooaplo aoaboro. Thoro aoy bo ooao dl ocroponcl 00 In colculotlng ouao ond 
dlffarancaa duo to rounding. 

"Quarter 1» tho quortor of ippllcitlon, aoy contain ooao oornlngo froa tho ported prior to 
application ond to tharafora oxoludod froa tho aooouroo of totol follow-up oaployaont ond oornlngo. 

A two-tailed t-toot wee applied to differences between oxporlaontol ond contro-l groupa. 
Stotlotlcol elgnlflcence lovolo oro Indlceted 001 • * 10 poroonti ■ 5 porcont| » 1 percent. 
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FIGURE 4.1 

AFDC-U APPLICANTS: TRENDS IN QUARTERLY 
EMPLOYMENT RATES AND AVERAGE EARNINGS 
(OCTOBER 1982 - AUGUST 1983 IMPACT SAMPLE) 
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SOURCE: See Table 4.2. 
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FIGURE 4.2 



AFDOU APPLICANTS: TRENDS IN AFDC RECEIPT AND 
AVERAGE PAYMENTS 
COCTOBER 1982 - AUGUST 1983 IMPACT SAMPLE) 
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SOURCE: See Table 4.2. 
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points in the final quarter, a difference that is not statistically signi- 
ficant. The pattern was similar for the Job Search group, with the impacts 
large in quarters 2 and 3 but then following an erratic course. However, 
in the final quarter of follow-up, the level of Job Search welfare receipt 
was 5 percentage points below that of controls, a statistically signifi- 
cant change. 

As previously noted, the AFDC-U welfare experience was markedly 
different from that of the AFDC's, with statistically significant payment 
reductions occurring in both program models. Over the 18-month period, 
welfare payments to the Job Search/EWEP experimental were reduced by $530, 
a statistically significant 15 percent decrease from the control group mean 
of $3,6 53- Welfare savings for the Job Search experimental s were also 
significant at $470. Quarter-by-quarter, the impacts were largest in the 
third quarter and then declined. Even in the sixth quarter, - however, 
savings were $65 for the Job Search/EWEP group and $85 for those in the Job 
Search program. These figures were statistically significant and represent 
a 14 and 18 percent change from the control group mean. Both groups 
received welfare for almost one month less than the controls. 

Examination of quarters 2 through 6 reveals one surprising finding: 
welfare reductions are noticeably larger than the increases in earnings. 
In this period (quarters 2 through 6), the Job Search/EWEP earnings gain of 
$216 was accompanied by a grant reduction of $497, twice the size of the 
earnings impact. For the Job Search only group, earnings gains of $384 
occurred at the same time as a $432 reduction in welfare payments, or 113 
percent of the increase in earnings. Since additional earnings do not 
usually cause a dollar- for-dollar decline in welfare payments — but in 
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this case were accompanied by larger reductions — the ratios found above 
are quite unexpected. Several factors together may help to explain why 
welfare savings can be relatively high in a program in which the overall 
employment rates and earnings are not significantly improved. 

For one, although the relationship above seems inconsistent with the 
rules and proceduros for grant calculations (where child-care and work- 
related costs oan be deducted from earnings before grants are calculated), 
AFDC-U* s — who are mostly male heads of a two-parent household — do not 
have as high expenses as the AFDC group, and therefore their grant levels 
are reduced more by any earnings. Second, as noted earlier, AFDC-U reci- 
pients losf all of their benefits if they work moi*e than 100 hours a month, 
and AFDC-U members d?d more frequently find full-time Jobs which paid 
higher wages, 1 Thus, new employment probably caused more AFDC-U case 
closings than it did among AFDC households. 

It is also important to remember that there was, in fact, a substan- 
tial short-term employment impact on this group, as noted in the second 
report and as seen in quarter 2 of Table H.2 in this report: a statistical- 
ly significant 5 to 6 percentage point gain for both groups. Because of 
the reasons above, this new employment probably resulted in a high 
proportion of case closings and may at least partially account for the 
decline in the peroent receiving welfare, a pattern that is not found for 
the AFDC group. As indicated in Appendix Table D.7, once off welfare, 
experimentals did not show a higher propensity than controls to return to 
it. 

Third, movement off welfare does not all have to be explained by new 
employment. Program requirements may cause some to leave the rolls. For 
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example, the sanctioning rate could have had a direct bearing on case 
closures since, for most of the demonstration period, sanctioning resulted 
in closure of the entire case, not Just the part applicable to the person 
sanctioned, 2 The sanctioning rates for the AFDC-0 experimental groups were 
higher than the controls: over a nine-month period, 6 percent of the Job 
Searoh/EWEP applicants were deregistered because of a requested sanction, 
as were 4 percent of the Job Search only experimental s. 

One final theory is also pertinent -- that the program identified 
people who were working at application and had earnings not reported to the 
welfare system. This hypothesis assumes that people with Jobs cannot both 
work and participate in a mandatory program as a condition of welfare 
receipt if that participation requirement means a substantial level of 
activity. Hence, it is reasoned, they will choose work and leave the 
rolls. To the extent that these earnings are already being reported to the 
31 system, employment levels as measured in this report will not be 
affected by individuals choosing to remain employed. To the extent that 
those Jobs were not previously reported to the welfare system, welfare 
measures will be affected. 

C. Impacts of the EWEP Add-On 

The results of the EWEP add-on are far less dramatic for the AFDC-0 
group than for the AFDC's. Similar to the second report findings on the 
early sample tracked for a year, the findings for the full sample followed 
for a year and one-half show that the add-on of work experience did not 
generally affect the employment or earnings levels of the AFDC-0 group. 
And, although the second report had noted somewhat larger (but not statis- 
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tically significant) grant reductions for the early sample due to EWEP, 
this was not true when the full sample was examined. EWEP did not lead to 
statistically significant reductions in welfare beyond the workshops, as 
the earlier analysis had suggested. 

Table 4.3 indicates that, over the five-quarter follow-up period, EWEP 
resulted in increased employment of 2 percentage points, but losses in 
earnings of $168. Welfare savings from the EWEP add-on were also small — 
$60 over six quarters — and welfare receipt was actually higher in some 
quarters, particularly the last one. Most of these small changes were not 
statistically significant, except for an overall increase in welfare 
receipt of 3 percental points. 

D. Impacts bv Applicatio n Period 

While the AFDC impacts overall were strongly affected by the period in 
which persons applied for welfare, this was much less true for the 
AFDC-U 9 s. The situation for AFDC-D controls in the later period was 
similar to that of the AFDC controls: they entered the sample with a lower 
prior employment and earnings level than the earlier AFDC-P controls. But 
within five quarters, these later applicants had caught up to and slightly 
exceeded the employment and earnings record of the earlier applicant 
controls, who were job hunting in a weaker economy. The later controls 
also entered the sample with somewhat higher welfare receipt and larger 
welfare payments. 

Tables 4.4 and 4.5 show that, over the five quarters, the later and 
early experimentals had fairly similar earnings gains: for Job Search 
only, $487 and $327 respectively; for the Job Search/EWEP groups, $184 and 
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TABLE 4.3 



SAN OIEGO 

AFOC-U APR- 1 CANTS: IMPACTS OF EMEP ADD-ON 
[OCTOBER 19B2 - AUGUST 1863 IMPACT SAMPLE) 





I 


I 




Outcome and Follom-Up Period 


Job Saarch-BtfEP 


Job Search 


01f ference 


Ever Employed. Quartare 2-6 (X) 8 


76.3 


74.0 


+ 2.3 


Average Niaber of Quarter* With 








Employment, Quartern 2-6 


2.S8 


2.54 


+ 0.04 


Ever Eaployed IX) 








Quarter of Application 


SO .2 


49.3 


+ 0.8 


luiarter *s 


AC O 
40 a C 


•90. D 


a. n q 

T U ad 


Quarter 3 


50.6 


47.8 


+ 2.8 


Quarter 4 


53.3 


s 52.4 


+ 0.8 


Querter 5 


54.4 


54.3 


+ 0.2 


Quarter 6 


53.2 


53.8 


- 0.7 


Average Totel Earnings* 








Quarters 2 - 6 [$) 


7360.54 


7528.56 


-169.02 


Average Totel Earnings ($) 








Quarter of Application 


762.97 


816.86 


- 53.89 


UUOrbOr c 




873.72 




Quarter 3 


1283.85 


1360**3 


- 66.58 


Quarter 4 


1557.06 


1648.53 


- 82.47 


umriBr 9 


1731 .SB 


17Q9.0R 


+ 23.47 


Quarter 6 


1628.37 


1836.70 


- 7.33 


Ever Received Any AFOC Payment. 








Quarters 1 - B IX) 


82.3 


78.5 

• 


+ 2.8* 


Averege N unbar of Months Receiving 








AFOC Payments* Quarters 1-6 


6.58 


6.68 


- 0*08 


Ever Received Any AFDC Payments IX) 








Quarter of Application 


75.8 


75.0 


+ 0.8 


uuarter c 


RR A 
QOt4 


RR A 


+ 0.0 


Quarter 3 


42.7 


43.2 


- 0.4 


Querter 4 


36.0 


38.0 


- 3.0 


Querter 5 


32.7 


32.5 


+ 0.2 


Querter 6 


30.2 


28.0 


+ 2.2 


Averege Total AFDC Payaante 








Received, Quarters 1 - 6 ($) 


3123.70 


3183.60 


- 58.80 


Avsrsge AFDC Paymenta Received [$) 








Quarter of Application 


701.01 


695.67 


+ 5.34 


Quarter 2 


618.88 


634.00 


- 15.02 


Querter 3 


508.58 


521.91 


- 12.33 


Quarter 4 


458.71 


500.34 


- 40.63 


Quarter 5 


428.86 


446.14 


- 17.18 


Quarter 6 


405.46 


385.54 


+ 18.83 


Sample 61ze 


1376 


831 
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TABLE 4.4 
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AFOC-U APPLICANTS t IMPACTS OF J06 6EARCH-EWEP, 8Y APPLICATION PERIOD 
(OCTOBER 1982 - AUGUST 1863 IMPACT SAMPLE] 





•Job Sauroh - EtfEP 




Ootobar 


1882 - March 


1983 


April 


- Auguat 


1983 


Outcoaa and Folloa-Up Quartar 


Exparlaantal 


Control 


Olffaranca 


Exparlaantal 


Control 


01 f f aranca 


Evar Eaployad, Quartara 














2-8 ix] a ; 


77.1 


72.7 


♦ 4.4» 


75.2 


75.2 


- 0.0 


Evar Eaployad, Quartara 














2-8 [*] - 


61 .6 


76.3 


♦ 5.3»» 


n/a 


. n/a 


n/a 


Evar Eaployad [X] 














Quartar of Application 


48.1 


48.6 


- 0.7 


61.2 


47.0 


4 4.2 


Quartar 2 


43 • 8 


36.4 


♦ 4.4 


4B.6 


42.8 


4 5.9* 


Quartar 3 


50.0 


49.4 


4 0.6 


61.1 


47.6 


4 3.6 


Qua r t a r 4 


63.6 


53.9 


- 0.3 


52.8 


53.5 


- 0.7 


Quartar 5 


54,5 


60.4 


♦ 4.1 


54.2 


55.1 


- 0.9 


Quartar 6 


52.7 


54.1 


- 1.4 


53.5 


57.4 


- 3.9 


Q ua r t a r 7 


55.7 


52.8 


4 3.4 


n/a 


ft/a 


n/a 


Quartar 6 


53.7 


63. 6 


4 0.2 


n/a 


n/a 


n/a 


Avaraga Total Earnlnga, 














Quartara 2 - 6 [1] 


7258.07 


7090.14 


4167.62 


7445.63 


7261.34 


4184.48 


- 

Avaraga Total Earnlnga, 












n/a 


Quartara 2 - B [I] 


1118B.50 


10668.70 


4320.74 


n/a 


n/a 


Avaraga Total Earnlnga [1] 














Quartar of Application " 


781 .22 


786.88 


- 15.74 


735.65 


674.65 


4 61.00 


Quartar 2 


782.62 


746.01 


•f 47.90 


1126.02 


852.58 


4173.43* 


Quartar 3 


1240.05 


1246.33 


- 6.26 


1351 .08 


1185.17 


4155.62 


Quartar 4 


1661. 1t> 


? 5) 63, 26 


-102.15 


1545.01 


1808.37 


4 36.64 


Quartar S 


1763 .27 


1 645.08 


4116.16 


1686.33 


1726.27 


- 38.94 


Quartar 6 


1800.73 


1780.48 


4110.27 


1737.38 


1678.83 


-142.56 


Quartar 7 


roiB.OO 


1872.41 


4143.58 


"n/a 


A/a 


n/a 


Quartar 6 


1833.87 


1836.58 


- 4.72 


n/a 


n/a 


n/a 


Evar Racalvad Any AFOC 














Payaanta, Quartara 1-6 [X] 


62.0 


82.4 


- 0.4 


62.8 


84.0 


- 1.2 


Evar Racalvad Any AFOC 












r/a 


Payaanta, Quartara 1-8 [X] 


62.5 


83.6 


- 1.1 


n/a 


n/a 


Evar Racalvad Any AFOC 














Payaant [X] 












- 1.7 


Quartar of Application 


74.6 


76.3 


- 1.7 


77.3 


78.0 


Quartar 2 


56 .5 


61.3 


- 4.6* 


54.3 


63.0 


- 8.7»»* 


Quartar 3 


44.4 


50.1 


- 5.6»» 


40.8 


50.1 


- 8.3*»* 


Qua r t a r 4 


37.8 


40.8 


- 3.0 - 


33.8 


42.8 


- 8.8»»» 


Quartar 6 


33.4 


37.6 


- 4.4* 


32.0 


34.3 


- 2.3 - 


Quartar 6 


28.7 


33.2 


- 3.6 


30.9 


32.7 


- 1.8 


Quartar 7 


26.1 


31.4 


- 6.3»» 


n/a 


n/a 


h/a 


Quartar 8 


25.8 


28.2 


- 2.4 • 


n/a 


n/a 


n/a 


Avaraga Total AFOC Payaanta 














Racalvad, Quartara 1-8 [1] 


8063.24 


3816.21 


-662.87»»* 


3207.47 


3669 .72 


-482 .25 •• 


Avaraga Total AFOC Payaanta 












n/a 


Rac«lvad, Quartara 1-8 [1] 


3766.38 


4543.48 


-777.10» ## 


n/a 


n/a 


Avaraga AFOC Payaanta 














Racatvfcd [1] 














Quartar of Application 


672.86 


662.96 


- 19.98 


735.96 


794.61 


- 58.63 


Quartar 2 


605.36 


700.11 


- 94.74»» 


637.70 


796.40 


-160.70»»» 


Quartar 3 


492.67 


633.21 


-140.36»*» 


631 .61 


646.36 


-117.78»» 


Quartar 4 


460.08 


566.55 


- 76. 47* 


437.60 


640.11 


-102.31 •• 


Coiirtar 5 


428.97 


552.58 


-122.62»»» 


428.7k 


464.6.8 


• 34.68 


Scartar 6 


361 .98 


460.78 


- 86.61»» 


434.66 


462.63 


- 17.87 


Quartar 7 


349.58 


473.23 


-123.68»»» 


n/a 


n/a 


ft/a 


QuarLar 6 


348.87 


436.71 


- 88.73»» 


n/a 


n/a 


n/a 


Ssapla Slza 


741 


488 




836 


314 





Q (continued) 



TABLE 4.4 [continued] 



6OURCE1 MORC calculations fro* County of Son Ologo aelforo rocorao ond Uneaployaent Znouronco rocordo 
froa the EPP Znforaatlon Syetea. 

HOT EF i Thaaa data Include zaro valuaa for aaapla aaabara not eaploytd and for aaapla aaabara not 
receiving aalfara. Thaaa data ara ra green 1 on-adj ua t ad uaing ordinary laaat equeree v controlling for 
pr e-eppl 1 oa tl on cherecterl atl ca of aaapla aaabara* Thara aay ba aoaa dl a cr a panel aa In calculating auaa and 
dtffarancaa dua to rounding. 

Only 16 aontha of folloa-up la available for tha latar appllcanta. 

"Quarter 1§ tha querter of oppllcrtloni aey conteln eoae eernlnge froa the period prior to 
eppllcetlon end 1e therefore excluded froa the aeeeuree of totel folloa-up eaployaent end eernlnge, 

A tao-telled t-teet aee applied to dlffereneee betaeen experimental end control group*. 
Stetletlcel elgnlflcence levele ere Indicated eet • » 10 percent! •• ■ 6 percent! K 1 percent, 

A tao-telled t-teet aee applied to dlffereneee In lapecte betaeen eppllcetlon perlode. 
8tet1et1cel elgnlflcence levele ere Indicated eex y ■ 10 percent* yy « 5 percent! yvy ■ 1 percent. 
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TABLE 4.6 



6AN OXEGO 





AFOC-U AIPLICANT6I 


IMPACTS 


OF JOB SEARCH, BY 


APPLICATION 


PERIOD 






(OCTOBER 


1682 - 


AUGUST 1863 IMPACT 


SAMPLE] 








1 

Job 6aarch 




Octobar 


1882 - 


March 1663 


I 


Apr 1 1 - Auguat 


1863 


Outcoaa and Folloa-Up Quartar 


Exparlaantal 


Control 01 f f aranca 


Exparlaantal Control 


01 ff aranca 


Evar Eaployad* Quartara 














• 

2-8 [*]" 


73.4 


72.7 


♦0.7 


75.0 


75.2 


-0.2 


Evar Eaployadi Quartara 














2 - B [I] 


77.9 


76.3 


♦ 1.6 


n/o 


n/a 


n/a 


Evar Eaployad [S] 














Quartar of Application 


46.8 


48.6 


-0.8 


60.4 


47.0 


♦3.4 


Quartar 2 


A *J 4 
44 . 1 


38.4 


♦3.6 


60.7 


42 .8 


▼ / . D 


Quartar 3 


47.1 


48.4 


-2.3 


48.1 


47.5 


♦ 1.6 - 


Qua r ta r 4 


51.3 


63.8 


-2.6 


-M.3 


63.5 


♦0.8 


Quartar 6 


63.0 


50.4 


♦2.6 


66.6 


66.1 


♦ 1 . o 


Quartar 6 


65.2 


64.1 


♦ 1.1 


61.6 


67.4 


-6.5 


Quartar 7 


86.8 


52.3 


♦3.6 


ri/a 


n/a 


n/a 


Quartar 8 


66.7 


63.6 


♦2.1 


n/a 


n/a 


n/a 


Avaraga Trial Earnlnga, 














Quartara 2-6 [I] 


7416.68 


7080.14 


♦326.71 


7748.13 


7261.34 


♦466.78 


Avaraga Total Earnings* 














Quartara 2-8 [I] 


11586.80 10666.70 


♦720.15 


n/a 


n/a 


n/a 


Avaraga Total Eernlnga [I] 














Quartar of Application" 


802.02 


786.86 


♦106.06 


666.05 


674.65 


♦ 11.40 


Quarter 2 


678.68 


746.01 


♦131.67 


1136.62 


862.58 


♦1 B4 . 02 


Quartar 3 


1336.85 


1246.33 


♦ 90.52 


1405.12 


1185.17 


♦208.85 


Qua r ta r 4 


1664.16 


T863.26 


♦ 0.80 


1633.44 


1608.37 


♦125.07 


Quartar S 


1686.55 


1645.08 


♦ 51.46 


T736.10 


1725.27 


~ 1 U . Dd 


Quartar 6 


1842.72 


1760.46 


♦ 62.26 


1836. BB 


1878.63 


- 43.08 


Quartar 7 


2081.74 


1872.41 


♦218.33 


n/a 


ft/a 


n/a 


Quartar 6 


2022.04 


1838.69 


♦ 63.45 


n/a 


n/a 


n/a 


Xvar Racalvad Any AFOC 














Payaanta, Quartara 1-6 [S] 


81.8 


62.4 


-0.6 


76.8 


84.0 


- 8.2»*»»y 


Evar Racalvad Any AFOC 














Payaanta, Quartara 1-8 [%] 


82.4 


83.6 


-1.3 


n/a 


n/a 


n/a 


Evar Racalvad Any AFOC 














Payaanta [%] 














Quartar of Application 


77.3 


76.3 


♦1.1 


71.1 


76.0 


- 7.0»»»» 


Quartar 2 


68.2 


61.3 


-3.1 


60 . 8 


63.0 




Quartar 3 


46.2 


50.1 


-3.6 


38.2 


60.1 




Qua r t a r 4 


41 .0 


40.8 


♦0.2 


35.5 


42.8 


- 7.8» 


Quartar 6 


34.4 


37.6 


-3.4 


28.3 


34.3 




Quartar 6 


26.8 


33.2 


-3.6 


25.0 


32.7 


- 7.7** 


Quartar 7 


24.6 


31.4 


-B.6»» 


n/a 


n/e 


n/a 


Quartar 8 


23.8 


28.2 


-4.3 • 


n/a 


n/a 


n/a 


Avaraga Total AFOC Payaanta 














Raoalvad, Quartara 1-6 [I] 


3211.62 


3616.21 


-404.60** 


3124.30 


3688.72 


-576.42»» 

* 


Avaraga Total AFOC Payaanta 














Racalvad, Quartara 1-8 [I] 


3868.37 


4643.46 


-644. 12** 


n/a 


n/a 


n/a 


Avaraga AFOC Payaanta 














Racalvad [I] 














Quartar of Application 


666.16 


682.66 


♦ 3.23 


682.87 


764.61 


-101.74* # » 


Quartar 2 


837.51 


700.11 


- 62.68 


625.68 


766.40 


-172.71»»» 


Qua r ta r 3 


622.65 


633.21 


-110.27»» 


517.66 


648.38 


-131.B3" 


Quartar 4 


612.11 


556.55 


- 44.44 


478.13 


540.11 


- 60.88 


Quartar 5 


466.03 


662.68 


- 8B.6f. r ' 


427.63 


464.68 


- 36.85 


Quartar 6 


3B6.E2 


460.76 


- 83.67*» 


381 .42 


452.63 


- 71.21 


Quartar 7 


351.63 


473.23 


-121.70»»» 


n/a 


n/a 


n/a 


Quartar 8 


355.36 


438.71 


- 84.34» * 


n/a 


n/a 


n/a 


6aapla 61za 


613 


488 




318 


314 
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$168. Welfare savings were also similar; for the Job Search/EWEP experi- 
mental, $492 compared to $553; for the Job Search only enrollees, $575 
compared to $405. None of these differences between application periods 
was statistically significant. 

Table 4.6 compares results for the two application periods to examine 
any HfEP effect. In general, there was none in either application period. 
The early group showed some losses in earnings but small welfare reduc- 
tions, neither of which was statistically significant. The later applicant 
group also showed some earnings loss; welfare receipt increased signifi- 
cantly as a result of the add-on, but this was not accompanied by 
significant changes in average welfare payments. 

The similarity by period for the AFDC-U's may be due to the overall 
greater employability of this population compared to the AFDC's, and their 
greater ability to find jobs in all types of situations, including 
different labor markets. 3 

E. Do Impacts Change O ver Time? 

To see whether impacts increase or decay over the follow-up period, it 
is of interest to examine more closely the data for the full sample over 15 
and 18 months as well as the trends from the two additional follow-up 
quarters available for the earlier applicants (those applying during the 
October 1982 through March 1983 period). Generally, the employment and 
earnings impacts were not very stable and declined over time, but welfare 
savings persisted for both groups in both program models. 

Table 4.2 indicates that, for the full sample, both employment and 
earnings peaked immediately following welfare application (quarter 2) but 
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TABLE 4,6 



SAN DIEGO 

AFDC-U APPLICANTS i IMPACTS OF THE ENEP ADD-ON, BY APPLICATION PERIOD 
(OCTOBER 1 968 - AUBU8T 1983 INPACT SAMPLE] 





i 

October 1068 - Hired 1BB3 


1 

April - August 1883 




Job Saerch- 






Job Search 


- 




OutcoMri end Folloi-Up Querter 


ENEP 


Job Search 


Difference 


ENEP 


Job Beorch 


Difference 


Ever Eiployed, Querters 














2 - 6 [I]' 


77.1 


73.4 


+ 3,7 


75,2 


76,0 


+ 0.1 


Ever Eiployed, Quer tt re 














2 - B [I] 1 


81 .8 


77.8 


+ 3i7* 


n/e 


n/e 


n/e 


ever tipioyid ilj 


i 












Quirtir of Application 




40, 8 


x n o 

+ U it 


R4 0 
01 ,C 


0Ua4 


x n o 


Quarter 2 


43.8 


43.1 


+ 0.8 


4B.8 


60.7 


- 1.8 


Quarter 3 


50,0 


47.1 


+ 3.0 


51.1 


48,1 


+ 2.1 


Querter 4 


DO id 


Olid 


+ e.d 


06,0 


KA 1 
04, d 


- 1.0 


Quarter 5 


54.5 


63.0 


♦ 1.5 


54.2 


66.8 


- 2.4 


Quarter 8 


52.7 


55.2 


- 2.5 


53.5 


61.8 


+ 1.8 


Quarter 7 


65.7 


55.8 


- 0,2 


n/e 


a/a 


n/e 


Querter B 


53.7 


55.7 


- 2.0 


n/e 


n/e 


n/e 


Avenge Totei Eerninge, 














Quarters 2 - MM 


7258.07 


7416.88 


- 158.78 


7446.83 


7748.13 


-302,30 

■ 


Averege ToteL Earninge, 














Quertere 2 - B [1] 


111AQ fid 
11109 |0U 


IlKflQ on 


*. 400 All 


n/e 


n/e 


n/e 


Averaoa ToteL Eerninae 111 

ni «i «Hg i v ■ ■ ■ ■ D I ll 1 II y • t t J 














Querter of AppL ictti on 


7B1.22 


802.02 


- 120,80* 


735,65 


686.05 


+ 48.60y 


Quarter 2 


782.82 


876.68 


- 83,67 


1126.02 


1136,62 


- 10.58 


Quarter 3 


1240,05 


1338.85 


- 88.80 


1351.08 


1405.12 


- 54,03 


Querter 4 


1561.10 


1684,18 


- 103.08 


1545.01 


1833.44 


- 88.43 


Querter 5 


1783.27 


1688.55 


t 68,72 


1886,33 


1738,10 


- 48.77 


Querter B 


1800.73 


1842.78 


t 68,01 


1737,38 


1836,86 


- 88.46 


Querter 7 


2016,00 


2081 ,74 


- 76,74 


n/e 


n/e 


n/e 


Querter 8 


1833,87 


2022.04 


- 88,17 


n/e 


n/e 


n/e 
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Outcoie and Folloi-Up Quarter 


October 1882 - Kerch 1883 


1 

April - Auguet 18B3 


Job 8aerch- 

» W» * H • 1 Mil 

ENEP 


Job Search 


Difference 


uoo oaarci 
EKEP 


Job Starch 


Difference 


Ever Received Any A«c 














Peyiontoi Quertere I 6 [t] 


» 82,0 


81.8 

v a o u 


+ 0.2 


AO 0 


/OaO 


1 1 Alii 

+7,0 Ml yy 


Ever Received Any AFOC 














Payien't, Quertere 1 - 8 [X] 


B2.fi 


B2.4 


♦ 0.1 


n/i 

II r 9 


n/i 


n/a 


Ever Received Any AFDC 














Peyiante [X] 














Quarter of Appllcetlon 


74,6 


77,3 


- 2.7 


77.3 


71.1 

rill 


+fi OMtitr 


Quartar 2 


GB.8 


58,2 


- 1,7 


54,3 


50,8 


+a,5 


Quartar 3 


44,4 


46,2 


- 1.7 


40,8 


08,2 


+2.8 


Quartar 4 


37,8 


41.0 

Tim 


. 9 9 

8,6 


W Q 


QR R 


-1 ,8 


Quarti.' S 

weou i ail u 


33,4 


34.4 


- 1,0 


32.0 


28.3 


+2.7 


Quarter 6 


28,7 


28,8 


- o,o 


30.8 


25.0 


+5,8* 


Querter 7 


26,1 


24.8 

e*T | w 


+ 1.B 


n/m 

n/a 


n/a 


n/e 


Quertcr 8 


2S.8 


23,9 


+ 2.0 


n/e 


n/e 


n/e 


Avenge Total AFDC Peyiante 














Received) Quertere 1 - 6 [$] 


3063.24 

• VMM I a*^ 


3P11 BP 

0 C 1 1 i OC 


-1AR QR 
140,00 


deU/ ,4/ 


3124,30 


AM J 1 

+ 83,17 


Averege Totel AFDC Payaenta 














Received, Quertere 1 - 8 (»] 


3766,38 


3888,37 


-132.88 


n/e 


n/a 

Mr ■ 


n/i 


Average AFDC Peyiante 














Received [1] 














Querter or Application 


672.88 


686,18 


- 23,22 


735,88 


882.87 


+ 43.11 


Quarter E 


605.36 


637.51 


- 32,15 


837.70 


826.88 


+ 12,01 


Quartar 3 


482,67 


522,85 


- 30.08 


531.61 


517,56 


♦ 14.05 


Quartar 4 


460.08 


512.11 


- 32.03 


437.80 


478,13 


-41.33 


Quartar E 




456.03 


- £6.06 


428.72 


427,83 


+ 2.08 


Quirt ir 6 


381.88 


386.82 


» 4,84 


434,66 


381.42 


♦ 53,24 


Quarter 7 


348.58 


351,53 


- 1.85 


n/e 


n/e 


n/e 


Querter 8 


348.87 


355.36 


- 5.38 


n/d 


n/a 


n/e 


Saiple Size 


741 


613 




835 


316 


17, 
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then decliLed so that, by the sixth quarter, the impacts were negligible. 
The two additional follow-up months for the early sample showed a slightly 
different trend, with employment and earnings rising, particularly for the 
Job Search group, but none of the impacts was statistically significant. 
(See Figure 4.3.) By the eighth quarter of follow-up, the earnings gain 
for the early Job Search applicants was $83. For the Job Search/HTEP 
group, the impacts had held up and grown in quarter 7 ($144) but then 
disappeared. (See Tables 4.4 and 4.5.) 

Welfare savings for the full sample were largest In the third quarter: 
thereafter, they dropped and stabilized at a lower level in both programs. 
The third-quarter 7 percentage point reduction was statistically signifi- 
cant and was associated with quarterly welfare savings of $131 and $118 for 
the Job Search/EWEP and the Job Search only experimental s, respectively — 
reductions of 20 and 18 percent from the control group payment average of 
$640 for t-he quarter. Although welfare savings declined, the amounts 
continued to be statistically significant in both programs. 

Statistically significant welfare savings continued for the early 
applicant group in both programs through quarter 8. Although the quarter- 
by-quarter impacts were somewhat erratic, by the end of the follow-up 
period around one-quarter of the applicants were receiving payments. In 
the eighth quarter alone, savings were between $84 and $90, representing 
between a 19 and 20 percent reduction from the control group average 
payment of $440. 

As in Chapter 3, impacts on earnings and welfare receipt were 
estimated for each sample member using data from the last two quarters 
combined. These estimates indicate that earnings gains for the AFDC-0's 
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FIGURE 4.3 



AFDC-U APPLICANTS: QUARTERLY TRENDS 
IN EMPLOYMENT RATES AND AVERAGE AFDC PAYMENTS 
(OCTOBER 1982 - MARCH 1983 IMPACT SAMPLD; 

Quarterly Employment Rate v*j 




Ouortor Relative To Application 



Average AFDC Payment* ($) 
900 




300 



X 2 ^or^ 3 0JO r^ r A S &jor<* r 6 ***** 7 QJ^ 

Quarter Relative To Application 



te<" 



Job Search-EWEP 
Experimental 0 

Job Search 
Experimental* 



Controle 



© SOURCE: See Tables 4.4 and 4.5. 

ERIC 



-us- i 7 7 



did not persist, but that welfare reductions continued over the longer run. 
More precisely, neither Job Search/EWEP nor Job Search only experimental j 
showed statistically significant earnings increases for the combined final 
quarters. The former group earned $86 less thai the control group and the 
latter group earned only $65 more, on a control group regression-adjusted 
average of $3t798. 

Welfare expenditures, on the other hand, were down by statistically 
significant amounts from the control group mean of $863 in the last two 
quarters. The savings were $119 for the Job S*arch/EWEP group and $125 for 
the Job Search experimental a — representing payments that ware about 1*} 
percent below the average payment of controls. 

F. Impacts on Other Income Sources 

The previous discussion has addressed the programs' effects on two 
important sources of income for sample members: welfare receipt and 
applicants 1 own earnings. However, contributions from family members (as 
well as from individuals both in and out of the household) may be parti- 
cularly important for the mostly male AFDC-U who, by definition, har 
spouse. As indicated in the second report, the six-month applicant : J* 
data found that, while the applicants' welfare be its and earnings were 
the two main sources of income, Unemployment Ins** ance (DI) compensation 
and Food Stamps were also important. Contributions from other family 
members, particularly their earnings and welfare benefits, were also 
prominent for the AFDC-U assistance category. 

Using UI administrative records, this section reports on the extent to 
which the San Diego programs affected receipt of UI compensation, it then 
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uses welfare, earnings and benefits data to examine program impacts on 
measured iiuome. 

1 . Onem lo yment Insurance Benefits 

Similar to the AFDC's, the AFDC-0 applicants 9 receipt of DI benefits 
was initially high for both experimented s and controls and thon declined, 
in this oase, from between 42 and 43 percent in the quarter of applica- 
tion to between 10 and 12 percent by the end of the follow-up period. Not 
only were these rates higher than those found for the AFDC's, the level of 
01 benefits was also considerably higher (see Tables 3.7 and 4.7). 
However, neither of the programs seemed to have much effect on this 
oe ; . te^n. 

Overall, there was a amall, positive increase in DI benefits ($18) for 
the Job Search only group. Job Search Initially reduced benefits but lat^r 
.led to increases. By the sixth quarter, impacts on benefits for the Job 
Search group reach-ad the statistically significant figure of $33i or a 51 
percent increase over the control group mean of $65. 

The pattern of 01 receipt aaong the Job Search/EWEP group was more 
erratic; overall, benefit-*? were reduced by a not statistically significant 
amount of $32. An initial decrease, followed by mostly increases, 
characterized this trend, although in the sixth quarter, there was a $14 
increase that was not statistically significant. 

While there were som& small differences in 01 benefit receipt between 
application periods, the patterns were not consistent. (See Appendix Table 
D. 3.) Later Job Search applicants shewed reductions in 01 benefits ($52 
over 18 months) compared to increased benefits for the earlier applicants 
($56). Benefit impacts for the Job Search/EWEP group were also mixed. 
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TABLE 4.7 



SAN OIEQO 



AFDC-U APPLICANTS i IHPACT8 OF JOB BEAR CH-EVEP AND 
JOB SEARCH ON UNEMPLOYMENT INSURANCE BENEFITS 
(OCTOBER 1882 - AU6U8V 1883 INPACT SAMPLE ) 



■ 

Qutcoas and FaL Lotr-Up Quartar 


Jot Unroll - 


EVER 


Job Starch 


Exparlaantal 


Control 


Oiffinnco 


Exparlaantal 


Control 


Olffirmci 


Evir Riciivid HI BiniTwi. 














Quartan 1 - 8 [X] 


DUiP 


01 it) 


- 1.0 


53.6 


51.8 


♦ 1.8 


Avariga Nuabar of Months 














«1 tH Ul Banaf 1 ti v 














Quartara 1 - 6 


2.88 


2.87 


- 0.10 


2.88 


2,97 


- 0.02 


Evar Aacahad UI Banaflti [1] 














Quartar or Application 


42.2 


42.8 


- 0.4 


42. e 


42.6 


♦ 0.2 


Quirtar 2 


, 32.1 


33,6 


- 1.4 


31.2 


33,6 


- 2.2 


Quirtar 3 


21.4 


23.6 


- 2.2 


HA 


23.6 


- 1.0 


Quirtar 4 


is n 

1 B i U 


in n 

1 v .D 


.no 


Id 


icq 
16.8 


- 0.4 


Quirtar 6 


11*1 


11.9 


- 0.8 


13.1 


11.9 


+ 1.2 


Quirtar 6 


10.1 


1Q.D 


+ 0.1 


11.8 


10.0 


+ 1.7 


Amiga Tctil UI Banafita, 














Quartan 1 - E [1] 


118B.71 


1232.18 


-32.47 


1250.16 


1232,18 


♦17.87 


Avaraga Total ill Banafita [1] 














(Luartar of Application 


m.u 


403.32 


-10.47 


382, 2B 


403.62 


-21,38 


Quirtar 2 


818.44 


M */ 


-37.63 


328.4B 


365.97 


-27.48 


Quarter 3 


207.88 


202.88 


♦ 6,31 


216.17 


202.68 


♦12.48 


Quartar t 


123.32 


117.3< 


+ 8,0* 


123.41 


117.31 


♦ 6.10 


Quartar '5 


77*14 




-.p.no 


TQ2.54 


B7.14 


♦16.43 


Quartar 6 


78.68 


«'M> 


rt^21 


"B8.28 


65.47 


♦32>82'« 


Saaplo 6i*i 


1376 


fi , 




831 


813 





SOURCE j HDRC cilculit'.ona trot tha UI BonaHta racorda froi till Btata of Ciiitornti. 

N0TE8t The flrat aonth of tha quarter of application 1i tha aonth In ihlch in Individual 1i randoily 
aaiiynid. Thin da ta inoluda xtro viluu for isap'r aaabara not racilvfng UI binifiU. Than data ara 
ragraaal on-adj uatad ualng aginary lint iquirn, controlling for pn-ippiicition chinstirtitlca of napli aaabara. 
Raflriaii j(i ontrrla alao iH.ludi prior US banaflt racaipt. Than ba son dlioripmclii In calculating iuii nnd 
dif faring! dui to rounding. 

Diffirancvi bitmn rmirch groupa in atatlaticalU i!gnH1oant Mil ng i uo-tailad t-tait at ths 
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(fc ^ the six quarters, the early applicant group experienced mostly benefit 
reductions (totaling $79, a figure that is not statistically significant), 
Hie later applicant group, in contrast, had higher benefits by about $48, 
again an amount that is not statistically significant. 
2. Impacts on Measured ^ng9B e 

For this analysis, information on welfare rayments and 01 benefits 
were aggregated into three-month calendar quarters that matched the CI 
earnings quarterly periods in order to obtain a measure of total income 
reflecting the three important income sources. Table 4.8 indicates that, 
over the five-quarter fcl.lw--*?;> period, the Job Searoh/EWEP model reduced 
measured income from the control group mean of $11,171 by $346, a 3,1 
percent reduction reflecting both the overall reductions in welfare 
payments and the level of 01 benefits received by this group -- for the 
most part losses that were, only to a small extent, offset by this group 1 s 
increased earnings. This loss was not statistically significant. The Job 
Search model reduced measured income by only $68, partly because of this 
group's increase in UI benefits. For both models, there were los^s in 
measured income through the sucth quarter, although these were not 
statistically significant. 

As with the AFDC's, the programs did not appear to affect the import- 
ance various sources of income to applicants, but, similarly, there were 
people in the sixth quarter (between 22 and 26 percent) who had not 
recorded either earnings, welfare payments or 01 benefits as income 
souroes. However, because the AFDC-0 applicants are rlways part of a 
two-parent family, it is likely that there was income other than that of 
the applicants. As noted in the second report, there were small increases 
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TABLE 4.8 
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during the sixth month in income received from other family members in both 
programs, although these increases were not statistically significant. 
There was also some indication that support was received from persons 
outside of the household, particularly in the Job Search program during the 
sixth month after application. 2 * 

During the sixth quarter, more than one-third of the experimental 
AFDC-O's bad earnings but no welfare or 01 benefit payments; the remainder 
received either welfare or 01 benefits or both. Fewer received both 
earnings and income from one of the two transfer programs. 

G. Subgroup Analysis 

As in Chapter 3, this section presents program impacts for various 
subgroup? of the AFDC-0 assistance category. Data for the full sample were 
used in order to have sufficient sample sizes for the analysis. 

1. Impacts hv Prior Welfare Dependency 

AFDC-0 1 s who had records of prior welfare receipt benefited most frotr 
the programs, with statistically significant and greater employment and 
earnings gains. There were also more welfare savings from this group than 
from those who said they had never been on welfare prior to random assign- 
ment. 5 B« spite these larger impacts, experimental s with a welfare history 
did not achieve the earning levels of experimental who had never been on 
welfare, and their average welfare receipt was still higher. (See Figure 
4.4 and Tiable 4.9.) Over the follow-up period, the earnings gains for 
those with some prior welfare dependency ranged from $816 for the Job 
Search/BHEP group to $1,466 for the Job Search only experimental s. This is 
an Increase of between 13 to 24 percent over the control group average 
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FIGURE 4.4 

AFDC-U APPLICANTS: AVERAGE EARNINGS AND AFOC 
PAYMENTS' BY PRIOR YEAR AFOC STATUS 
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NOTE: Earnings are averaged over quarters 2-6, AFDC Payments are 
averaged over quarters 1-6, 
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ANO JOB SEARCH, BY PRIOR AFOC RECEIPT HISTORY 
(OCTOBER 1882 - AUGUST 1883 INPACT SAMPLE) 
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TABLE 4.9 (continued] 
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earnings. For those without prior welfare receipt, the losses in earnings 
were not statistically significant. 

Welfare payment reductions for those with some prior dependency ranged 
from $793 to $1,760, depending on both the program model and the length of 
prior welfare receipt. These reductions brought the payment level down by 
18 to 33 percent from the control group average over the 18 months ($4,482 
to $5*262). Those with no prior welfare receipt had reductions of only 
$145 (for the Job Search group) and $258 (for the Job Searoh/EWEP group), 
reductions that were not statistically significant and just 5 to 9 percent 
lower than the average control group 18-month payment level of $2,982. 
(See Figure 4.4 and Table 4.90 This pattern of greater welfare savings 
for those with prior welfare dependency (as compared to those with no prior 
welfare history) continued into the sixth quarter. 

2. Impacts hv Prior Wor k History 

In general, neither subgroup based on yaar-prior employment had statis- 
tically significant employment or earnings gains. 6 Gr&p the follow-up 
period, however, there were similar statistically significant payment 
reductions and decreases in welfare receipt for both experimental s with no 
recent work history nv<] those with u ir rscpt work history. (See Figure 4.5 
and Table D.4.) The total 18-month mi?*r< reduction for those with no 
recent work history came to between $1,015 and $1,021, down approximately 
one-fifth from the control group mean of $4,908. Those with some recent 
work history experienced reductions of only ;? tween $253 and $334, a 
decrease of 8 to 11 percent from the average control group payment level of 
$3t155. Even in the sixth quarter, individuals with no recent work history 
continued to experience larger welfare reductions than those of the more 
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FIGURE 4.5 

AFDC-U APPLICA' ■ AVERAGE EARNINGS AND AFQC 

payments: by , ; 1R year employment status 
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NOTE: Earnings are averaged over quar-ers 2-6, AFDC Payments are 
averaged over quarters 1-6, 
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recently employed. 

These data thus suggest that both program models had their strongest 
welfare impacts on individuals who would have, in the absence of special 
services, received the largest welfare payments. There was, however, no 
evidence to suggest a consistent impact on employment- related outcomes for 
individual* categorized by recent work history. The findings of somewhat 
larger impacts for the more disadvantaged, primarily in welfare measures, 
parallel the results for the full AFDC-U sample, for which there were 
significant welfare impacts but no corresponding effects on employment and 
earnings. 

3. Impacts bv Prior PI Benefit pe^nf. 

When the impacts for those v T ho rf reived 01 benefits in the six months 
prior to random assignment were compared to those who had not, people in 
-both programs with no prior receipt had larger employment and earnings 
gains and welfare savings, the latter being statistically significant. 
These results are generally similar to those found in the prior employment 
subgro»iD analysis. In fact, the "prior 01 benefits" category may serve as 
a proxy for prior employment since, to receive 01 compensation, one needs 
to have worked previously. (See Appendix Table D.5.) 

4. Impacts bv Number of Children 

Lastly, impacts were computed separately for families with one child 
and for those with more than one child since larger welfare savings may be 
expected for larger families with higher grant levels. in fact, somewhat 
greater welfare savings and greater reductions in welfare receipt were 
found for the larger families in both programs. Positive and statistically 
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CHAPTER 5 
BENEFIT-COST ANALYSIS 



This chapter presents an evaluation of the benefits and costs of the 
EPP Job Search program and the Job Search/EWEP sequence in San Diego. 
Benefit-cost analysis provides a useful way to compare the effects of 
programs to their costs. Moreover, the approach used in this evaluation, 
one based on techniques developed in previous evaluations of social 
programs, 1 allows both the economic efficiency and the distributional 
consequences of the two program models to be assessed systematically for 
the groups served by the programs. 

This chapter focuses on key aspects of the analytical approach and on 
the results of the evaluation rather than on the Intricacies of the 
analysis itself — its numerous underlying assumptions, distinctions and 
calculations, several thousand in all. The first section of the chapter 
provides an overview of the analytical framework. The following two 
sections present the individual benefits and costs that are considered. 
The fourth section aggregates these benefits and costs to produce the 
overall results and examines how benefits and costs vary according to the 
group being served; this section also assesses the sensitivity of the 
results to key assumptions and the programs 1 budgetary impacts by level of 
government. The last section interprets the significance of the results 
for policy. Readers who are interested in the more technical aspects of 
the benefit-cost evaluation, as well as in further details on data sources, 
should consul t an earl ier paper which documented these features of the 
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analysis. 2 

The results presented below differ from the preliminary results 
provided in the second report on the San Diego program (Goldman et al. f 
1985) . The earlier results were based on data collected through December 
1983; program benefits and costs that accrued after that time were not 
estimated. This analysis uses an additional year of follow-up data and 
estimates future benefits and costs. Modifications in some estimation 
procedures, which are all noted either in the text or the footnotes of this 
chapter, have also been made. 

A. Analytical Approach 

The heart of this analysis is the benefit-cost accounting framework 
summarized in Table 5.1. That franuvork indicates the components 
considered in the benefit-cost analysis and the perspectives from which 
they are valued. From the social perspective, all benefits and costs are 
valued for society as a whole, and the way in which benefits accrue bo 
groups in society is ignored. This is the perspective usually used to 
judge whether a program is an economically efficient use of resources., The 
perspective of the welfare applicant considers benefits and costs to the 
applicants assigned to the Job Search and Job Search/EWEP groups, and 
determines whether these groups fare better or worse as a result of the 
program. The third perspective is that of everyone in society other than 
the welfare applicants. Often termed the "taxpayer "3 perspective, it is 
usually politically important. To assess the various budgetary impacts of 
the programs, this taxpayer perspective can be broken down by level of 
government. 
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TABLE 5.1 
SAN DIEGD 

EXPECTED EFFECTS OF COMPONENTS OF THE BENEFIT-COST ANALYSIS, BY ACCOUNTING PERSPECTIVE 
j j 
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These perspectives and components constitute the underlying structure 
of this analysis. Because welfare applicants and taxpayers together are 
defined to include everyone in society, the benefit and cost values for 
these two perspectives add up to the values for society as a whole. Thus, 
transfers between applicants and taxpayers entail no net change to society. 
However, benefits or costs to one group that are not offset by correspond- 
ing costs or benefits to the other do involve real changes in the resources 
available to society and are listed in the social accounting oolumn of 
Table 5.1. For example, since a reduction in AFDC payments is a benefit to 
taxpayers and a loss to applicants, the effects cancel each other out from 
the perspective of society as a whole. However, any resulting administra- 
tive cost savings are a social benefit because the gain to taxpayers is not 
offset by a reduction in the well-being of welfare applicants. 

Table 5.1 presents the components considered in the framework and 
lists them under the benefit or cost heading according to their expected 
net impacts from each perspective. As the AFDC example above illustrates, 
components may affect taxpayers and welfare applicants quite differently. - 
The table also cites the data sources used in valuing the components. 

The values of the tangible benefits and costs were estimated by first 
measuring the effects of the program and then valuing these effects in 
dollars. Program effects were* estimated as the experimental-control differ- 
ences in means for several different program enrollment and outcome 
measures. t For earnings and welfare impacts, the mean differences were 
estimated using the Unemployment Insurance records and AFDC data described 
in Chapter 2. For the other outcome measures, data came from the applicant 
and the worksite surveys and information collected on the use of alterna- 
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tive training programs as well as from Unemployment Insurance and AFDC 
records. The factors valued in estimating program operating costs -- 
differences in the length of Job Search and EHEP enrollment — were 
measured using Job Search workshop and EHEP attendance logs in addition to 
BPPIS data. In all cases, the experimental-control differences indicated 
how the experimental groups 1 experience differed from what it would have 
been had the programs not been implemented. 

These effects were then valued in terms of the resources produced, 
saved or used as a result of Job Search and EHEP. The costs of these 
resources were estimated in 1983 dollars using published data and program 
expenditure records. This resource-cost approach is practical, consistent 
and relatively easy to interpret. However, it does not take intangible 
effects into account, and it accurately values tangible effects only 
insofar as the social demand for these resources is reflected by the cost 
estimates. 5 

Benefits and costs have been estimated for each of the four experi- 
mental groups in the demonstration: AFDC Job Search, AFDC Job Search/EHEP, 
AFDC-D Job Search, and AFDC-U Job Search/EHEP. In addition, the estimates 
have been disaggregated according to applicants 1 prior work experience. To 
do this, experimental-control differences in enrollment and outcome 
measures were calculated separately for each experimental group and then 
valued using the resource-cost estimates. In most instances, these 
estimates did not vary by experimental research group, but the exceptions 
will be noted. As a result, benefit-cost findings can be compared by 
research group to ascertain differences in the relative effectiveness of 
the Job Search and the Job Search/EHEP models as well as the relative 
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effectiveness of serving different groups of welfare applicants. 

All benefit-cost estimates reflect effects on program participants as 
well as nonpar ticipants for reasons explained below. One of the inten- 
tions of programs with mandatory participation requirements, such as EPP 
and STEP, is to deter welfare applicants from receiving welfare. Participa- 
tion need not occur for a program to serve as a deterrent. Moreover, costs 
are associated with nonpar ticipants as well as participants, including the 
costs of contacting and registering welfare applicants, enforcing mandatory 
participation requirements, as well as the costs of program reporting and 
administration required for these activities. 

The data used to estimate various benefit and cost components cover an 
observation period beginning in October 1982. As indicated in Chapter 2, 
random assignment to the experimental and control groups began in August 
1982, but only applicants assigned after September 1982 are included in the 
analysis. The end of the observation period varies by data source from 
September 1984 (for program enrollment data) to March 1985 (for Unemploy- 
ment Insurance benefits data). Program benefits and costs accruing after 
the end of the observation period — up to five years after random assign- 
ment — have been estimated on the basis of these data and a series of 
assumptions. All benefits and costs have been discounted to reflect 1983 
dollars. 

Given that applicants were randomly assigned between October 1982 and 
August 1983, the length of observation ranges between 13 and 29 months (on 
average, 21 months) depending on the time of application and the data 
source. This is shown in Figure 5.1. For example, for an applicant assign- 
ed in October 1982, the length of observation for earnings data is 26 



-137- 



FIGURE 8.1 



BA.lt DIEGO 

AVERAGE LENGTH OF TINE UNTIL FIRST ACTIVITY AND END OF PROGRAM PARTICIPATION FOR PARTI CI PANTS* » 

BY APPLICATION PERIOD AND RESEARCH GROUP 



ATION PERIOD 
SEARCH GROUP 

p 1882 - M»rch 1 8B3 

Saarch 

Baaroh - EWEP 



END OF OBSERVATION PERIOD 
(BY DATA SOURCE) 



1883 - August 
Baaroh 

Baaroh - EVEP 



* — ~xo~ ——————————————————— ^j^^wiwiw:^^:^:^-- — 

£ a i i i ■ i u — — — — — — — _____ _ _ _ _ _ _;^:^.;^.^:^;^j^j>^:!^;_ 



rm-r i i i i i i i i i i |TT-rt I i nnrTTTl 

una Oct Aba r Fabruary Juna Octobar Fabrui 



Ootobar 
1882 



Fabruary 
1883 



Juna 
1883 



OctAbar 
1883 



Fabruary 
1BB4 



Juna 
1884 



Octobar 
1884 



Fabruary 
1885 



a Avaraga Month of 
oatlon for Raaaar 
Baapla Maabara Wh 

Appllad Ootobar - 

* Avaraga Month of 
oatlon for Raaaar 
Baapla Naabara Vh 

Appllad April - A 

x Avaraga Month of 
Activity fltart 

o Avaraga Month of 
Progroa Activity 



DURCEl NORC ealoulatlona froa EPP Inforaatlon ayataa anrollaant data. 

OTE81 Unbrokan llnifc Indloata avaraga tlaa froa applloatlon' to atart of ffrat activity. Bold Unaa Indlcata avaraga langth of atay 
Job Goaroh or EWEP. Brokan Unaa Indloata langth of poat-partl cl pa tlon obaarvatlon. 

"participation la daMnad aa attandlng Job 8aaroh for at laaat ona day. 

b 

Tha and of tha obaarvatlon parlod aaa Baptaabar 1884 for prograa tracking racorda, Dacoabar 1884 for Unoaployaont Inauranoo ai 
•» Fabruary 1885 for AFDC raoorda, and March 1885 for Unaaployaant Inauranca banaflta racorda. 



200 



ERIC 



months. The period of observation in this case includes between 22 and 24 
months of postprogram follow-up (that is, after program participation) 
because the average time between application and completion of program 
activities is about two months for the Job Search group and four months for 
the Job Search/EHEP group, 6 

The length of postprogram follow-up was obviously shorter for succeed- 
ing groups of applicants. At the extreme, an applicant assigned to the Job 
Search group during August 1983 had an average earnings follow-up of 14 
months and, if in the Job Search/EWEP group, 12 months. However, these 
figures are averages; follow-up on individual applicants was more or less 
than the average. In a few cases, applicants had not yet completed program 
activities by the December 1984 cutoff. As discussed later in this 
chapter, the limited length of follow-up means that the results are subject 
to some uncertainty. 

b. Benefits 

The principal benefits of the Job Search and the Job Search/EHEP 
sequence are increased output, increased tax payments, reduced dependence 
on transfer programs, and reduced use of alternative training programs. 
These benefits will be discussed in turn. 

1. Increased Output 

Experimentals in the Job Search and Job Search/EHEP groups produced 
more goods and services during the observation period than did their 
counterparts in the control group. First, EHEP participants were assigned 
to work experience positions in government agencies and nonprofit organi- 
zations; they provided labor while obtaining job experience. Second, both 
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groups of experimental on average worked more hours in regular labor 
market jobs than controls, generating another net increase in output. 
These two types of output will be addressed separately because the benefits 
associated with each were estimated using different methods and data 
sources. They will also be treated differently within the accounting 
framework outlined above. 

The goods and services that the Job Search/EWEP group produced in work 
experience assignments were used by the general community and hence repre- 
sent a benefit to both taxpayers and society as a whole. For example, 
participants worked as groundskeepers in local parks, clerks and typists in 
public schools and agencies, and program aides in youth and senior citizen 
services organizations. 

In keeping with the resource-cost approach, the value of this output 
was estimated as the supply price of the labor service provided -- that is, 
the cost to an agency of obtaining alternative labor to supply the same 
service. Data from the worksite survey, EHEP attendance logs and EPPIS 
were used to calculate the value of this output. First, the productivity 
of EHfEP participants relative to regular workers was estimated by agency 
staff who supervised the participants. 7 This was used to calculate a 
productivity ratio that was multiplied by the number of hours participants 
were assigned to the job during the period they were actively working** in 
order to provide an estimate of the time regular workers would take to 
perform the same work. For the AFDC group, an estimated 44 hours of 
regular workers' labor per experimental (or 291 hours per EHEP participant) 
would have been needed to do the work. For the AFDC-U group, the estimate 
was 52 hours per experimental (273 hours per EHEP participant). 
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This estimate, in turn, was multiplied by regular workers' wage rate 
(marked up for fringe benefits), which yielded the supply price estimate 
used in the analysis. 9 The average rate for the work done by the AFDC 
participants in 5WEP was $i|.i»8 per hour (plus 1? percent for fringe 
benefits); the rate was $5-30 (plus 15 percent for fringe benefits) for the 
AFDC-0 1 s. Osing this approach, the value of the output produced by EHEP 
participants was estimated to b<* $205 per AFDC experimental and $354 per 
AFDC-0 experimental assigned tc the Job Search/EWEP group. 

The higher estimate for the AFDC-0 group reflects three factors. 
First, as indicated in Chapter i|, the rate of participation of the AFDC-0 
experimentals in EWEP was higher than for the AFDC experimental s; thus, the 
number of hours they worked was also higher. Second, the average produc- 
tivity of AFDC-0 participants was rated as very high — higher, in fact, 
than the regular workers to whom agency supervisors compared participants. 
This finding is consistent with the high ratings of AFDC-0 participants 1 
skills, effort and dependability given by the supervisors in the worksite 
survey. 10 The average productivity of AFDC participants was 87 percent 
that of regular workers, a reasonable level given the limited work 
histories of some participants. Third, as indioated above, the average 
regular wage rate for EWEP jobs held by AFDC-0 participants was higher than 
the rate for AFDC participants, reflecting the difference in the job tasks 
performed by the two groups. 11 

Increased output also resulted from the regular jobs held by both Job 
Search and Job Search/EHEP experimentals after they left the program. 
Experimental-control differences in earnings were used as the basis for 
valuing the net increase attributable to the Job Search/EHEP sequence, as 
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seen in Table 5.2. For the AFDC group, the earnings difference during the 
observation period was $788 for those assigned to the Job Search/EWEP group 
and $693 for those assigned only to Job Search. The differences for the 
AFDC-0 experimental s were also positive but smaller: $312 and $231, respec- 
tively. Readers should bear in mind that these figures reflect aggregate 
earnings differences through December 1984 for all experimental s and there- 
fore differ from the regression-adjusted earnings results for individual 
quarters reported in Chapters 3 and 4. 

Assuming that labor markets are competitive, employers will pay total 
compensation equal to the value of a worker's marginal product. 12 Thus, 
the estimate of the value of the increase in output due to the program was 
based on the experimental-control differences in earnings. The calculation 
also took account of nonwage compensation, which national employment compen- 
sation data indicate is about 18 percent of earnings in the relatively low- 
wage jobs held by most experimentals and controls. 13 The resulting fringe 
benefits estimates are shown in Table 5.2. 

The value of employees* output benefits taxpayers, but because they 
also pay for the output, the net value to them is zero. In contrast, the 
net increase in wages and other compensation is a benefit to welfare appli- 
cants and a net benefit to society as well. The value of the EWEP output 
is also a benefit to society, but the social gain is distributed different- 
ly: the value of EWEP output is a benefit to taxpayers and does not affect 
experimentals. 11 

TWo important caveats need to be considered concerning output compo- 
nents* First, unlike regular labor market output, the EWEP output was 
produced under conditions in which employers did not demonstrate a willing- 
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ness to pay for it; there was no direct cost to them of obtaining EWEP 
labor services. Thus, the supply price of the output does not necessarily 
reflect demand for the output, although there is evidence that the demand 
was substantial J 5 second, in working in both EWEP assignments and regular 
jobs, experimentals may have displaced other workers who subsequently 
became unemployed. To the extent displacement occurred, the net value of 
the increased output to society was reduced, because society gave up the 
output that would have been produced by the displaced workers. However, 
the short-term displacement caused by EWEP jobs appears to have been 
minimal ;16 and the relative?/ low unemployment in the San Diego area, 
particularly in the later months of the demonstration, makes it likely that 
many workers who were displaced by experimentals either in EWEP or regular 
employment could have found other jobs. 
2. Increased Tax Payments 

Experimentals 1 earnings gains from regular jobs resulted in increased 
tax payments, including federal and state income taxes, Social Security 
payroll taxes, and state sales and excise taxes. These taxes have been 
imputed based on experimentals' earnings (total earnings in the case of 
payroll and sales taxes, earnings over a base amount for income taxes), 
other income (for sales taxes), marital status and dependents, the relevant 
tax rates and average consumption patterns. The resulting estimates are 
consequently experimental -oontrol differences in legal tax incidence. 1 ? 

The overall differences in taxes for AFDC experimentals were $151 for 
the Job Searoh/EWEP group and $132 for the Job Search only group. The 
differences for the two AFDC-D experimental groups were $59 and $49, 
respectively. Federal income and Social Security taxes accounted for most 
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of this. Thus, slightly less than one- fifth of the earnings increase 
received by experimental s went to taxpayers in the form of higher tax 
payments. Because this benefit to taxpayers was offset by a loss to 
experimental s f there was no net benefit or cost to society as a whole. 
3. Reduced Dependence on Transfers 

In part because of their increased earnings, experimental s reduced 
their dependence on public transfer programs, thus generating two types of 
benefits. First, the reduction in cash and in-kind transfers represented a 
benefit to taxpayers and a loss to welfare applicants. As in the case of 
the increase in tax payments, this reduction resulted in no net social 
benefit. Second, the reduced use of transfer programs freed administrative 
resources, benefiting both taxpayers and society. 

Changes in five types of transfers were estimated: welfare (AFDC), 
Food Stamps, General Relief, Unemployment Insurance, and MediCal. Experi- 
mental-control differences in total welfare payments and 01 benefits during 
the follow-up period (as opposed to the differences for the fixed period 
covered in Chapters 3 and 4) were estimated using AFDC and 01 records 
data. 1 8 Applicant survey data were used to estimate experimental-control 
differences for General Relief. 1 9 

Differences in the other transfer payments were not directly measured, 
but were estimated using various data sources. Food Stamps differences 
were imputed on the basis of household income (including earnings; AFDC and 
01) and the earnings disregard (18 percent of earnings) as well as child 
care and medical deductions used to determine both Food Stamps eligibility 
and the amount of benefits. 20 Finally, differences for MediCal were 
estimated based on the regulations in force at the time of the demonstra- 
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tion, which specified that persons who were off the AFDC rolls for more 
than four months were not eligible for MediCal in most cases. Differences 
between experimental and controls in the number of months of MediCal 
ineligibility were estimated. These differences were then valued on the 
basis of the. average monthly payments made to MediCal participants who were 
public assistance recipients in the County of San Diego during fiscal year 
1983. 21 

The results are presented in Table 5.3. The welfare (AFDC) payments 
of all four experimental groups decreased. The reductions for the AFDC-0 
research groups ~ $817 for the Job Search/EHEP group and $724 for the Job 
Search group -- were roughly double the $l|11 and $326 reductions for the 
AFDC groups. The pattern of MediCal effects was about the same, which is 
not surprising given that MediCal eligibility is mainly determined by AFDC 
status for the population served by the programs. The reductions in 
MediCal benefits for the AFDC-D group were larfjcr than those for the AFDC 
experimental 0. 

The other results, however, do not follow this pattern of reductions. 
First, Unemployment Insurance was higher for experimentals than for 
controls, except for the AFDC applicants assigned to the Job Search/EHEP 
group, whose DI payments showed virtually no change. The size of those 
increases in DI benefits are small compared to the preliminary estimates 
reported earlier. 22 Given that more experimentals than controls got jobs, 
some of the increases in DI benefits may be attributed to those who gained 
and later lost jobs, thus becoming eligible for DI. 

Second, Food Stamps transfers decreased for the AFDC research groups, 
but increased for the AFDC-D groups. For the AFDC 1 s, relatively large 
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earnings increases and relatively small reductions in welfare and in DI 
payments account for their reduced eligibility for Food Stamps. In 
contrast, for the AFDC-0 1 s, small increases in earnings and large welfare 
reductions led to small Food Stamps increases. Finally, General Relief 
payments increased by snail amounts for all experimental groups except AFDC 
Job Search. 

The overall reduction in transfer payments to AFDC-U experimentals was 
very large: over $800 per experimental for both Job Searcb/EWEP and Job 
Search experimentals. This overall finding reflects the substantial 
reductions in welfare and MediCal payments, offset to some extent by 
increases in 01, Food Stamps and General Relief. The overall reduction for 
the AFDC group was less substantial. This net reduction was a little more 
than half the AFDC-0 savings — $573 and $i|i|3 for the Job Search/EWEP and 
Job Search groups, respectively — due to the fact that welfare and MediCal 
reductions were much smaller. 

Changes in the administrative costs incurred by the five transfer 
programs were also estimated by multiplying the experimental-control 
differences in transfer payments by the estimated average administrative 
cost per dollar of transfer. The administrative cost figures were derived 
from data for the County of San Diego, the State of California, and the 
federal government covering the fiscal year 1 983 . 2 3 

The resulting estimates in Table 5*3 generally mirror the findings for 
transfer payments. The estimated administrative cost savings were $69 and 
$64 per experimental in the AFDC-0 Job Search/EWEP and Job Search groups, 
respectively, with most of the savings coming from the welfare program. 
Again, the savings for the AFDC groups were smaller. These cost savings 
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were a benefit to taxpayers and, inasmuch as the applicants were 
unaffected, a benefit to society as we a. 

4. Reduced Dse of Alternative Tra ining Programs 

The principal employment and training services available to members of 
the control group were classroom training and individual job search through 
the WIN Program and, for those eligible, training provided under the Job 
Training Partnership Act (JTPA). A small number of experimental also 
received these services. In addition, a few members of the control group 
participated in the Food Stamps Horkfare program operated in San Diego. 24 
Since more of these training resources were devoted to controls than to 
experimental s, the net cost of these resources must be taken intc account 
in this analysis. The costs associated with registering and assessing 
controls are treated separately in the "Program Operating Costs" section 
below. 

The training service that controls enrolled in most frequently was WIN 
classroom training in health occupations provided in the Employment Service 
Program (ESP); a few experimentals also participated. ESP class attendance 
data were collected to determine the difference in the use of this program 
by experimentals and controls. 2 5 EPPIS data were used to estimate the 
participation of controls and experimentals in WIN training programs other 
than ESP, as well as in individual job search. Finally, the applicant 
survey data were used to assess the use of the JTPA and Food Stamps 
Workf are programs. 

Based on these data, experimental-control differences in the use of 
training options were calculated. On average during the observation 
period, controls were actively enrolled in individual job search for about 
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half a day more than experimental and in WIN training classes for half a 
day to a full day more than experimental s t depending on the experimental 
group. Controls also participated in JTPA and Food Stamps Horkfare 
slightly more often than experimental s. These differences were valued 
using training program cost data obtained from WIN, the Regional Employment 
and Training Consortium (RETC, the JTPA agency in San Diego) and time-study 
data for the work experience unit of the San Diego Department of Sooial 
Services. 2^ 

The resulting estimates of the cost savings associated with the 
reduced use of alternative training services varied between for the 
AFDC-U Job Search group and $57 for the AFDC Job Search/EWEP group. The 
experimental s f less frequent use of the ESP program accounted for most of 
the savings, which constituted a benefit to taxpayers and to society as a 
.whole. 

In addition, participants in these training alternatives could receive 
assistance with child care, transportation and other training- related 
expenses. Data on the cost of these services for WIN registrants (both 
experimentals and controls) indicated small reductions for both the AFDC 
and AFDC-U experimental groups. These reductions were a benefit to 
taxpayers and a loss to experimentals, producing no net social benefit. 

5. Future Benefits 

The benefits discussed thus far were estimated for the observation 
period only. However, the analysis also addresses the benefits that occur 
after this period. To calculate these benefits, assumptions were made 
about how the size of the impacts changed after the observation period. 
Four specific assumptions were used in extrapolating benefits from 
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increased output aiid taxes and reduced dependence on transfers. These 
assumptions pertain to the base estimate, time horizon, decay rate and 
discount rate. 27 

First, the base estimate selected for extrapolation was the experi- 
mental-control impact difference (for example, the difference in earnings) 
for the last two quarters of the observation period (for the earnings data, 
this period covers July through December 1984). This is the most recent 
evidence available, and therefore is the most appropriate basis for 
extrapolation. Chapters 3 and l| presented regress! on- adjusted estimates of 
impacts for these . last two quarters, while this analysis has used 
unadjusted estimates. 

Second, the time horizon over which the benefits were extrapolated was 
set at five years from the point of random assignment. This is approximate- 
ly the average length of time AFDC applicants remain on the rolls nation- 
wide. 28 Thi S uniform horizon implies that benefits are to be extrapolated 
into the future for different lengths of time, depending on the date of 
random assignment for each person. For example, for someone enrolling 
between October 1982 and March 1983, the observation period was approxi- 
mately eight quarters, depending on the data source, and hence benefits 
were extrapolated for three years. For those enrolling between April and 
August 1983, however, only six quarters could be observed, so extrapolation 
covers three and one-half years. 

Third, the decay rate is the rate at which the base estimate is 
assumed to change over time. Decay rates were estimated for the earnings 
and AFDC impacts during the observation period, 29 and these rates were 
assumed to apply in the extrapolation period. Separate rates were computed 
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for each of the four experimental groups and for the application periods 
from October 1982 through March 1963 and from April through August 1 983. 
The results indicate that impacts did decay over time — that is, experi- 
mental-control differences declined in size from their levels in the second 
or third quarter after random assignment — but that the amount of the 
decay varied by experimental group and period of assignment. The estimated 
quarterly decay rates for earnings varied between zero and 39 percent, 
depending on the group, while the welfare decay rates ranged from 5 to 22 
peroent per quarter. The decay rates for Job Search/EHEP were substantial- 
ly lower than those for Job Search — in other words, the Job Search/EWEP 
impacts lasted longer than the Job Search impacts. The earnings decay rates 
were used for both the earnings and taxes benefits, while the welfare rates 
were used for all transfers. These estimates are obviously very important 
.to the extrapolation procedure and, therefore, the sensitivity of the 
results to alternative decay-rate estimates will be tested in the following 
section of the chapter. 

Finally, the discounting procedure adjusted future benefits to their 
1983 dollar values. This procedure took account of both inflation and the 
value of foregone investment after 1983. A real discount rate — that is, 
a rate adjusted for inflation — of 5 percent per year was used for this 
purpose. 

30 

Table 5*4 presents estimates of the observed benefits, the estimated 
future benefits, and finally the total estimated benefits of EPP and EWEP. 
The extrapolated benefits substantially increase the total benefit 
estimates for both AFDC groups. For the AFDC-D groups, the extrapoi ation 
also increases the size of total benefits over those observed except in the 
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151 


270 


162 


43 3 


Tax Payaanta 


5B 


-15 


42 


47 


41 


68 


TranaTar Payaanta 


8B2 


681 


1572 


616 


754 


1671 


TranaTar Prograa Ada 1 n 1 at r a 1 1 on 


66 


53 


116 


62 


56 


117 


Raducad Uaa of W IN 


55 


0 


55 


44 


0 


44 



SOURCESi NORC calculation* froa Unaaployaant Inauranca racordaj AFOC data} applicant aurvayj aorkatta aurvayf EPP 
Inforaatlon 8yataa anrollaant dataj EPP, EKEP, WIN and JTPA prograa coat racordaj and publlahad data on aelfere coetei tax rataa, 
and aaployaa frlnga banarita. 8aa taxt for daacrlptlona of thaaa sourcaa. 

NOTESi Raaulta ara axpraaaad In flacal yaar 1S63 dollara and tharafora alll not praclssly aatch oboarvad raaulta praaantad 
In Tablaa 5.2 and 5.3. Bacauaa of rounding, datall aay not aua to totala. 

a 

Baaad on available folloa-up data. 
b Extrapolatad banarita ara ootlaated froa tha and of tha obaarvatlon period to five yoara froa the point of rondoa 

aeal gnaont. 
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case of earnings and taxes for the Job Search/EWEP group. 

It should be remembered that all estimates of program benefits in the 
table are unadjusted experimental-control differences in outcomes for the 
entire observation period, not regression-adjusted estimates for fijced 
follow-up periods reported in Chapters 3 and H. Adjusting for exogenous 
differences between the experimental and control groups — as was done in 
estimating employment and welfare impacts — is clearly desirable. 
However, the benefit-cost analysis must simultaneously weigh a nunber of 
different program outcomes and costs. Making adjusted estimates of all 
benefit and cost components that are comparable to those used in Chapters 3 
and 4 would require additional data collection and assumptions, as well as 
further statistical modeling not undertaken for this analysis. Given that 
adjustments in all components could not be made, the consistent use of 
unadjusted estimates permits all benefits and costs to be weighed on the 
same scale. 

In most instances the unadjusted estimates of earnings and welfare 
effects in Table 5.4 do not differ substantially from adjusted estimates. 3 1 
However, these differences — together with the fact that estimates for the 
benefit-cost analysis cover the entire observation period, not fixed 
follow-up periods — mean that the estimates in Table 5*4 differ from the 
impact findings presented earlier. The sensitivity of the overall 
benefit-cost results to the use of unadjusted rather than adjusted 
estimates is discussed later in this chapter. 

C. Costs 

BPP and EWEP costs fall into two categories: (1) program operating 
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costs and (2) allowances and support service costs. Costs in the first 
category include staff salaries and fringe benefits, expenditures for 
facilities, and other related expenses. The second category includes 
allowances paid to experimental s, as well as child care, transportation and 
other support services. 

1. Program Operating Costs 

Estimating the net operating costs of providing Job Search and EWEP 
sent ices to experimental is a oooplioated matter. One of the difficulties 
is that demonstration costs were charged against a number of different 
program accounts, to which other program costs were also charged. Another 
problem is that the operating costs of EPP Job Search and EWEP apply to all 
program enrollees, not just to those in the experimental and control 
groups. The estimation of costs thus entails numerous decisions about how 
to allocate total program expenditures. 

A six-step procedure was used to estimate costs. First, the resources 
used in the two programs — and the accounts to which these costs were 
assigned — were identified. EPP and EWEP operations in the state and 
local offices of EDD and DSS had been charged to separate EDD and DSS 
demonstration grants, five different EDD WIN accounts and two County of San 
Diego WIN accounts, as well as to EDD and County general-purpose accounts. 
In addition, some support service costs were charged to other program 
accounts, as discussed below. 

Expenditure data for these accounts were collected for the five 
quarters of program operations between Ootober 1982 and December 1983* 
These data not only include all of the operating costs of serving experi- 
mental s and controls, but also the costs incurred for people served by EPP 
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or EWEP who were not in one of the demonstration research groups. 

Second, the total operating costs incurred at the local level by EDD 
and DSS offices during this five-quarter period were allocated among the 24 
program functions listed in Table 5.5. This allocation was based on a time 
study of work activities in the EDD and DSS offices as well as data 
obtained from EPPIS and staff interviews. 

The time study was conducted during a two-week period in August 
1983. 32 Staff recorded the time they devoted to 20 EPP, EWEP and KIN 
functions as well as to unrelated activities (personal leave, and other 
programs such as the Employment Service and Food Stamps). Although some 
functions were clearly related to one of the two programs for experimental 
or to the regular WIN Program for the control group, other functions could 
not readily be assigned to one or the other. For example, the same staff 
members registered EPP and control group applicants, and it would have been 
difficult to assess the amount of time spent on the different groups. 
Therefore, in the time study the staff simply recorded the amount of time 
demoted to registration as a whole, and that amount was allocated between 
EPP and WIN based on EPPIS data identifying the number of applicants in 
each group. 

Part or all of some EPP Job Search functions were associated with the 
demonstration research, not ongoing operations, and were thus excluded in 
estimating net operating costs. The amount of staff time devoted to 
research-related activities was determined from the time study and from 
staff interviews. All of the EDD staff time spent on random assignment, 47 
percent of the EDD staff time and 12 percent of the DSS staff time devoted 
to program reporting, and 20 percent of all the time spent on administra- 
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TA8LE 5.5 



6AN DIEGO 

EOD ANO D86 OIRECT LABOR COSTS, 
BY PROGRAM FUNCTION 



T 





Percent of Olrect Lsbor Costs 


Function 


500 


086 


Job Starch 9eg1 strati on Functlona 






JWP Job Search 


4.6 : 


0.0 


Raglatratl on/Or 1antat1 on 


6.3 


4.4 




2.3 


3.7 


Ada 1 n1 atr at1 on/Suparv 1 a1 on 


2.6 


2.1 


Total 


16.3 


10.2 


Job Saarch Ongoing Functlona 






Counaal 1 ng/Peyaente and 






Support Sarvlcaa Arrengeaante 


8.3 


6.0 


Noncoapl lanca Folloa-Up 


7.6 


0.3 


Job Saarch Workshop 


18.1 


15.0 


Poat J8A Sarvlcaa 


3.6 


5.7 


Progrsa Reporting 


6.8 


11.0 


A flu 1 n i strati o n/ supervision 


8.3 


10.0 


Total 


54.8 


48.0 


EVEP Functlona 






Pleceaent and CounaaMng 


0.1 


2.8 


Support Sarvlcaa Arrangements 


0.0 


1.7 


Progrsa Reporting 


O.B 


2.7 


Noncoapl lance Follow-Up 


0.0 


1 .2 


Ada 1 n1 etr etl on/Superv 1 e1 on 


0.5 


2.7 


local 


1.4 ' 


11.2 


V IN Functlona 




* 


Ragl etr etl on/Or 1 entet 1 on 


4.3 


1.7 




1.0 


1.5 


Prograa 8erv 1 cee/Suppor t Serv 1 cee 






Ar rcngcacnt* 


5.2 


6.0 


Progrra Reporting 


2.B 


5.0 


Ada1n1 etretl on/6uparv1 alon 


2.4 


3 .7 


1 o t a l 


15.7 


17,8 


Reeeerch-Rel eted Functlona 






Randoa Aeelgnaent 


0.0 


5.3 


EVEP Start-Up Coats 


0.3 


2.5 


Progrea Reporting 


8.6 


2.4 


Ada1 n1 atr st1 on 


1.5 


3.3 


Total 


11.3 


13.5 


; 

Totel 


100.0 


100.0 



SOURCES: NORC till study of 088 end EOti eteff hours spent on EPP end EWEP 
end dete on 088 end E00 eteff eelaMee. 

NOTE t 01etr1but1one say not add exectly to 100.0 percent beceuee of 
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tion, was judged to be related to research, 33 

Third, the resulting allocation of staff time was valued using perti- 
nent wage rates, yielding a functional breakdown of direct labor costs. 
This breakdown can be considered representative of the five-quarter period 
over which operating oost data were collected, except in two respects that 
required adjustments. The first adjustment was needed because fewer 
resources were devoted to EWEP functions during the first three quarters 
than the time study indicated due to the fact that a number of EWEP staff 
were hired during the summer of 1983* A second adjustment was required 
because much of the staff time devoted to EWEP during the first quarter 
(October through Dacember 1 982) was associated with program start-up, not 
ongoing operations. 

34 

The final allocation of direct labor costs by program function is 
. shown in Table 5*5* This allocation indicates, for example, that 19 
percent of EDD labor costs and 15 percent of DSS labor costs were devoted 
to the job search workshops, A substantial portion of staff time was 
devoted to monitoring noncompliance, including efforts to bring individuals 
into compliance with EPP and EWEP rules and to institute sanctioning 
procedures. Also notable is the fact that about one-fifth of the labor 
costs of both EDD and DSS were devoted to program reporting that was not 
required for the other functions listed in Table 5.5 (such as registra- 
tion), A large part of this reportir^ «?»s res. arch-related. 

The fourth step involved aggregating the labor costs into the five 
program categories shown in Table 5*5, determining the fraction of total 
labor costs in each category, and then allocating all personnel and non- 
personnel costs accordingly for the five quarters ending in December 1983, 
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All operating costs incurred in the local offices were divided into (1) EPP 
registration costs, (2) ongoing EPP costs, (3) EWEP costs, (4) WIN regis- 
tration and ongoing oosts (for controls), and (5) costs related to research 
and start-up. Costs in the first three categories together constitute the 
total operating oosts of EPP and EWEP; the fourth category includes all 
costs associated vith WIN registration, assessment and referrals /or 
controls. 

Operating costs incurred for administering EPP Job Search, EWEP and 
WLi at the state level were estimated and allocated proportionately among 
the lour operating categories. Because San Diego was one of six counties 
involved in the statewide demonstration, EPP v s share of state-level 
demonstration expenditures was estimated to be one-sixth. The share of WIN 
state- level expenditures for EPP was estimated as 7.H percent, San Diego's 
fraction of the State's on-board WIN registration during fiscal year 
1983. 35 

The next step involved estimating the following three unit costs to be 
used in calculating the net operating oosts for the four research groups: 

• Net EPP registration cost per experimental — This is the cost 
of EPP registration (the first cost category) per experimen- 
tal, minus the cost of WIN registration per control (part of 
the fourth cost oategory). 

• Net EPP ongoing cost per working participation day — This is 
the ongoing EPP cost '(the second category) minus the cost of 
ongoing WIN functions (the remainder of the fourth cost 
category) per EPP enrollment day. 

• Net EWEP cost per EWEP enrollmen t day — This cost includes 
all EWEP functions (the third cost category) and is expressed 
per EWEP enrollment day. 

EPPIS data were used to generate the enrollment unit denominators for the 

first of these three unit costs, while Job Search workshop and EWEP 
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attendance logs were used for the other two. The unit estimates are 
experimental-control differences through September 1984.3 6 

Finally, as shown in Table 5.6, experimental-control differences in 
EPP Job Search participation and EHEP enrollment for each of the four 
research groups were multiplied by the unit costs. These differences 
reflect the entire observation period for enrollment data of October 1982 
through September 1984. The figure used for days in EPP is the number of 
days of active participation in the job search workshops, and the nunber of 
EHEP days covers the period from referral to EWEP through completion of the 
work assignment. 37 

Because the average amount of participation in the job search work- 
shops was slightly greater for AFDC-U's than for AFDC's, the EPP cost per 
AFDC-U experimental was proportionately higher. In addition, the cost of 
serving Job Search/EHEP experimentals in both assistance categories was 
higher than that for the Job Search only group. As a result, the operating 
costs of the demonstration ranged from a low of $537 for the AFDC Job 
Search applicants to a high of $696 for the AFDC-U experimentals assigned 
to the Job Searoh/EHEP group. These estimates reflect the net operating 
costs of EPP and EHEP that is, the gross EPP/EHEP costs of serving 

experimental s38 minus the costs of serving controls. These costs consti- 
tute the largest single expenditure for taxpayers and for society as a 
wnole, 

2o Allowances and Support_JSer vices 

The second category of EPP ani EHEP costs includes the allowances prid 
to experimentals during Job Search, as well as the child care, transporta- 
tion assistance, and other support services provided during Job Search and 
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TABLE 5.6 



SAN 0IE60 

ESTIMATED LENGTHS OF ENROLLMENT AND NET ENROLLMENT COSTS 
PER EXPERIMENTAL FOR THE OBSERVATION PERIOD 8 » 
BY ASSISTANCE CATEGORY AND RESEARCH GROUP 



pa of Cost 


Maan Length of Enrollment (Days] 


Operet 1 ng 
Cost of 
Enrol Iment 
(per dey] 


Total Coat 


AFDC 


AFOC-U 


AFDC 


AFDC-U 


Job 

Search- Job 
EWEP Search 


Job 

Search- Job 
EWEP Seerch 


Job 

Search- Job 
EWEP Seerch 


Job 

Seerch- Jo 
EWEP Seer 


t EPP Ragl strati on 
t EPP Enrollment 

b 

t EN EP Enrollment 


4.71 4.91 
21. B9 -0.30 


6.44 6.12 
2B.06 0.33 


95.70 
4.11 


$88.03 $68.03 
460.76 4B9.BB 
B9.97 * -1.23 


$68.03 *6B 
620.B1 4B9 
107.07 1 


tal Nat Coats 


BOB. 75 63B.BB 


BB6.71 669 



SOURCESi MDRC calcuLatlona fro* program coat date, EPP Information System dote, EWEP logs end Job ! 
tendance logs. 

NOTES r The enrollment dey means are beeed on e sample of 3235 Job Seerch - EWEP experimental, 11 
b Seerch experimental a end 1B84 controls. 

B The end of the observation period mas September 19B4 for program tracking records. 

b Some members of tha control and Job tJeerch group did enter EWEP. Therefore! me have use* 
rollmant — thet 1 s» tha experimental-control differences 1n enrollment* to estimate casts. 
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EWEP. These allowances and services were funded by several sources. 
Expenditure data on allowances and support service costs paid by EDD for 
program participants were collected by EDD in an automated accounting 
system. Cost data for services funded by other sources were assembled frcm 
individual case file records. 

EDD paid a job search allowance of $5 per day of attendance at the 
workshops. The cost of this job search allowance per experimental was 
estimated using EDD data. 39 The resulting allowance estimates are 
presented in Table 5.7, along with estimates of the costs of support 
services. The estimates varied from $20 to $23 per experimental for the 
AFDC and AFDC-U Job Search/EWEP groups respectively. 

Child-card assistance was provided by EDD (charged to WIN), DSS (also 
charged to WIN accounts), CDF (Child Development Funds managed by the 
Education Department) and County funds. EDD paid for child care provided 
during Job Search at a cost of $4 per AFDC experimental and $1 per AFDC-U 
experimental. The amount of money spent on subsidized child care during 
EWEP was surprisingly small : CDF and WIN incurred child-care costs of only 
$3 per AFDC Job Search/EWEP experimental, and less than $1 per AFDC-U 
experimental. The reason that average child care costs are so low is that, 
while the cost per experimental who received child care assistance was $62 
for those in Job Search/EWEP and $59 for those assigned to Job Search 
alone, only about 5 percent of experimental s received such assistance. 

Transport jn reimbursements and bus tokens were provided by WIN 
(EDD), WIN f JE? (both DSS), and County funds. Miscellaneous assistance 
for clothing and uniforms, emergency needs and other items was provided by 
EDD, WIN and County funds. The average value of the transportation 
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TABLE 6.7 
SAN DIEGO 

ESTIMATED NET C06T6 OF EDO ALLOWANCES ANO 6UPP0RT SERVICES 
PER EXPERIMENTAL FOR THE OBSFHVATIQN PERIOO*, 
BY AS6Z6TANCE CATEGORY ANO RESEARCH GROUP 







AFOC 


AFOC- 


U 


Type of Coat 




Job Search- 

EWEP 


Job 
See rch 


Job Seerch- 
EWEP 


Job 
Search 


EOO Alloeaneee 




•20.06 


•20.35 




■ gg g a 
fee ic4 


Child Cars 

EOO Child Cero 
Other Child Core 




4.01 
3.02 


4.02 

0.12 


0.64 
0.24 


0.80 
0.00 


Total Child Cera 




7.03 


4.14 


0.6B 


0.80 


Transported on 




2.22 


0.3B 


4.05 


2.16 


Other Support Services 




2.12 


1.66 


B.33 


5.76 


Total 


•31.43 


•26.53 


•36.30 


•30.88 



SOURCEi MDRC celculetlone froe prograa coat tifite.^ 

NDTESt A few aoabero of the control croup received EOO elloeences end ' 
eupport eervlcee during the obeervetlon period. In odd1t1on» ooao other eupport 
eervlcee ere evelleble to aeabere of both the experimental end the control 
group*. Therefore, the net coete of olloaoncoe end eupport eervlcee — thet 1s» 
the expeMaentel-control dlfferencee 1n coete per experimental — heve been 
eotlaotod. 

a The end of the obeervetlon period aoo Merch 18B5 for eupport 
eervlcea end June 1865 for EOO olloaonuoo. 
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assistance ranged from less than $1 to $4 per experimental, depending on 
the research group. The cost of the other assistance varied between $2 and 
$8 per experimental. 

Total net allowances and support service costs — that is, the costs 
for experimental s 1 * 0 minus the costs for controls — were highest for experi- 
mental assigned to the Job Search/EWEP group. The cost was $31 and $36 
for experimental s in the AFDC and AFDC-D assistance categories, respec- 
tively, and slightly lower for experimental in the Job Search group. It 
important to underscore that these amounts are expressed per experiment- 
al; the costs per participant are considerably greater than these figures 
while the costs per nonpartieipant are approximately zero. Because the 
cost of these allowances and services to taxpayers is offset by their value 
to experimental s, no net social cost results. 

In addition, experimental s themselves bore some of the costs of child 
care and transportation. These out-of-pocket expenses were estimated for 
QfEP, using worksite survey data, as $15 per AFDC experimental and $16 per 
AFDC-U experimental; most were for transportation. Out-of-pocket expenses 
for EPP Job Search enrollment, which were probably small, were not 
measured. 

Finally, in estimating costs for this benefit-cost analysis, the focus 
has been on the average operating and support costs of serving experiment 
tals over and above what it costs to serve controls. However, policymakers 
are also interested in the full cost of serving an experimental who regis- 
ters and then completes the maximum three weeks in Job Search and 13 weeks 
in EHEP. This cost was estimated to be approximately $1,200 for registra- 
tion and Job Search and |400 for the addition of EWEP. The cost is 
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slightly higher for AFDC experimentals because of their child-care needs. 
The cost of job search and work experience for an experimental who leaves 
the programs before reaching the participation limits is correspondingly 
less. As indicated in Chapter 3, participants leave the programs to take 
regular jobs, because their status has changed, and for other reasons, 

D. Regultg 

In presenting the results of the analysis, the overall findings will 
be discussed first and the results for subgroups will follow. The 
sensitivity of these results to assumptions used in the analysis will also 
be assessed. Finally, the budgetary implications of the results will be 
evaluated by level of government. 

1. Overall Results 

The findings for the benefit and cost components discussed above, 
discounted to reflect 1983 dollars, are added together in Tables 5.8 and 
5.9. The first table covers the two AFDC experimental groups, and the 
second corresponds to the two AFDC-U groups. The results suggest that the 
programs' total benefits over a five-year time horizon exceeded their costs 
from the point of view of society as a whole for all experimental groups 
except the AFDC-D Job Search/EWEP group. However, both the amount of net 
social value generated and the way in which that value is distributed 
between applicants and taxpayers varied widely depending on the treatment 
and assistance group. 

For the AFDC groups, the estimated social net present value is highly 
positive — $1,096 for applicants assigned to Job Search only and $1,952 
for those assigned to both Job Search and EWE P. To a great extent, these 
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TABLE 5.8 
8AN OIEGO 

AFOC APPLICANTS! E8TIMATE0 BENEFITS ANO COSTS PER EXPERIMENTAL AFTER FIVE YEARS, BY RESEARCH GROUP ANO ACCOUNTING PERSPECTIVE 



i ; r 





Job Search - EWEP 


Job Seerch 


nponent of Analyele 


Sod eL 


Accounting Perspective 
AppL 1 cent 


Tenpey er 


Social 


Accounting Perepuctlve 
App 1 1 cent 


Texpey 


nef 1 te 














Output Produced by Portiolponto 
Velue of In-Progrea Output 
Increaaed Output froa Ea pi oy as n t 


$205 

2232 


• 0 

2232 


$205 
0 


-$3 
1536 


$0 

1536 


-$3 
0 




0 


-371 


371 


0 


-235 


235 


Reduced Uee of Trenefer Progreae 
Raducad AFOC Peyaente 
Raducad Puyaanta froa Othar Progreae 
Raducad AFOC Adail ni atra tl va Coata 
Raducad Adail ni atr atl va Coata of Other 
Prograaa 


0 
0 

57 

25 


-740 
-336 
0 

0 


740 
336 
57 

25 


0 
0 

35 

16 


-453 
-228 
0 

0 


463 
228 
35 

16 


a 

Preference for Hork Ovar Welfere 




♦ 


♦ 


♦ 


+ 


+ 


Reduced Uee of Othar Prograaa 
Raducad ALLoaeneee 
Raducad Operating Coata 


0 

53 


-4 
0 


4 

53 


0 
46 


-4 
0 


4 
48 


■ te 














Progrsa Operating Coate 
EPP Operating Coate 
EHEP Operetlng Coete 


-516 
-89 


0 
0 


-516 
-89 


-535 
1 


0 
0 


-535 
1 




0 


31 


-31 


0 


26 


-28 


Participant Out-of-Pocket Expenses 


-15 


-15 


0 


0 


0 


0 


e 






0 






0 


t Present Velua (BenoMto Hlnue Coete) 


• 1952 


$797 $1155 


$1096 


$644 


$452 



SOURCES! NORC eeleulotlono froa UneapLoyaent Ineurance recorder AFOC dete; applicant eurveyi worksite eurveyi EPP Inf orao 1 1 on 8yeti 
rollaent dotes EPP, EHEP, HIN end JTPA progrea coet records} end published data on welfare coete, tex retee, end eaployee fringe benef 
i text for deecrlptlone of theee eourcss. 

N0TE8I Coapononta era Hated ee beneflte or coete eccordlng to e priori expectetlone regerdlng their velue froa the eoclel 
'epectlvs. Hoaever, the results preeented reflect eotuel outooaee, not expectetlone. Positive eaounte Indlcete e benefits negetlve 
lunte Indlcete e coet. All beneflte end ooete ere eetlaeted for e flve-yeer tlae horizon beginning et eppllcetlon, end ere expreeeed 
13 doLLare. Beceuee of rounding* detell aey not sua to totsls. 

"Theee ere Intangible effecte not aeeeured In this enelyele. 
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TABLE 5.9 
8AN OIEGO 

AFOC-U APPLICANTS I E8TINATEO BENEFITS 0 COSTS PER EXPERIMENTAL AFTER FIVE YEARS, BY RESEARCH GROUP ANO ACCOUNTING PERSPECTIVE 

r : r 





Job Search - EWEP 


Job Seerch 


Component of Analyele 


Sool el 


Acoountlng Perepeotlve 

Appl 1 cunt 


To xpay ar 


8oc1 el 


Acoountlng Perepeotlve 
Appl | cent 


Texp 


Senef I te 














Output Produced by Participants 
Valua of In-Prograa Output 
Inoraaaad Output froa Eaployaent 


1354 
151 


-10 
151 


0384 
0 


-15 

433 


-80 
433 


- 


Inoraaaad Tax Peyaente 


0 


-42 


412 


0 


-88 




Raduoad Uaa of Tranafar Prograaa 
Raducad AFOC Payaanta 
Raducad Payaanta froa Othar Propraaa 
Raducad AFDC Adal nl at ra t 1 v a Coata 
Raducad Ada 1 nl at ra 1 1 v a Coata of Othar 
Prograaa 


0 
0 

1 04 
14 


-1351 
-221 

o 

0 


1351 
221 
104 

14 


0 
0 

102 
15 


-1325 
-246 

o 

0 


13 
2' 
1 1 


Prafaranca for Work Ovar Welfare" 


♦ 


♦ 


♦ 


♦ 


♦ 




Raducad Alloaoncoa 
Raducad Operating Coata 


0 
55 


b 

0 


b 
55 


0 
44 


b 

0 


4 


ioate 














Progroa Operating Coata 
EPP Operating Coote 
EWEP Operetlng Coete 


-585 
-108 


0 
0 


•685 
-108 


-555 
-1 


0 
0 


-5C 


ALLoeencee end Support 8ervlcee 


0 


38 


-36 


0 


31 




Participant Out-of-Pooka t Expeneee 


-18 


-18 


0 


0 


0 




Foregone Pereonel end Feally Activities" 






0 








lot Preeant Value (Beneflte Nlnue Coat) 


-188 


-11443 


11414 


143 


-11188 


$122 



80URCE8I NORC celouietlona froa Uneaployaent Ineurenoe recordei AFOC dates applicant ourveyi eorkalta eurveyj EPP Infraction 8yi 
inrollaent doto| EPP. EWEP. WIN and JTPA progrea ooet reoordei end publlehed dote on aelforo coata. tax retee. erd eaployee fringe ben« 
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results reflect the overall earnings gains experienced by these groups. 
The estimated social net present value of Job Search/EWEP is larger than 
that of Job Search alone because of its greater impact on output: (1) Job 
Search/EWEP had about a 50 percent greater effect on output from employ- 
ment and (2) QJEP generated work-experience services worth an estimated 
$205 per experimental. 

Figure 5*2 presents the social net present value of the two models 
graphically over time — from the point of welfare application through the 
following five years. The figure indicates that the social net present 
value of these two models became positive well before the end of the 
observation period. The social value of Job Search/EWEP reached the break- 
even point sooner mainly because the value of the EWEP services — which 
was substantially higher than their cost — save it a short-term boost. 
After reaching the breakeven point, the net value of Job Search/ EWEP 
increased faster because of greater earnings gains in the second year of 
observation. As shown in the figure, there is uncertainty about the 
magnitude of benefits after the observation period although they are 
clearly positive. The shaded area of the figure indicates the extent of 
this uncertainty: the lower-bound estimates assume no future benefits, 
while the upper-bound estimates assume that observed benefits for the last 
two quarters continue into the future with no decay. 

Not only does society as a whole benefit from the two models, but both 
groups within society that are considered in this analysis — welfare 
applicants and taxpayers — benefit as» well. The net value of the two 
programs to AFDC applicants is approximately the same: $644 for those in 
Job Search and $797 for those assigned to Job Search/EWEP. The larger 
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earnings gain for applicants in the Job Search/EWEP group is offset to a 
great extent by increased taxes and reduced tranfers. Thus, most of the 
additional social net present value generated by EWEP accrues to taxpayers; 
their net gain is $1,155 per Job Search/EWEP experimental, compared to $452 
for Job Search alone. 

The results are quite different for AFDC-U applicants. The social net 
present value of the two models is only $43 per AFDC-U applicant assigned 
to Job Search and is slightly negative for applicants in Job Search/EWEP. 
Equally Important, while taxpayers gain substantially — well over $1,000 
per experimental for each program — welfare applicants lose approximately 
as much. This loss for applicants results from the program's modest effect 
on earnings compared to the reduction in transfers; indeed, the welfare 
reductions alone amounted to more than twice the total cost of the two 
programs. 

Figure 5.3 graphically depicts the social net present value of Job 
Search and Job Search/EWEP over time for AFDC-U applicants. As indicated 
in this figure, the cost of Job Search is paid back within five years after 
random assignment, while Job Search/EWEP breaks even during the observation 
period and then loses ground with slightly negative results projected for 
the future. The short-term performance of Job Search/EWEP is relatively 
more positive due to the value of EWEP services. The curves showing the 
net present values of both programs are relatively flat following the 
observation period — with the line for Job Search rising slowly snd that 
for Job Search/EWEP declining slightly primarily because projected 
future earnings differences are small. However, the two net values 
composing social net present value — that is, the values to applicants and 
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Figure 5.3 
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taxpayers — differ dramatically. The curve for the value to applicants 
has a steeply negative slop6 and the one showing the value to taxpayers has 
a correspondingly positive slope; the flat slope for social net present 
value that appears in the figure results from summing over these two 
subgroups, 

2. ni«q mr?ff flted Results 

Disaggregating these overall results yields several important insights 
into the effectiveness of the two program models. The analysis dis- 
aggregates the benefit-cost results by period of application for welfare 
and by amount of prior work experience, 

Period of Application . The benefit-cost results by period of 
application for welfare mirror the pattern for impacts discussed in 
Chapters 3 and As indicated in Table 5.10, benefits were greater for 

- experimentals in both programs who applied between October 1982 and March 
1983 than for later applicants. The difference between application periods 
is greatest for AFDC applicants assigned to Job Search, The early 
assignees generated a social net present value of $3,470 per experimental, 
while the social value for later assignees was -$3,758, Thus, the overall 
net present value of $1,096 masks a pronounced inconsistency in the 
effectiveness of the Job Search model in serving these two groups. This 
difference may reflect varying economic conditions, characteristics of 
welfare applicants, or simply random chance; whatever the explanation, the 
finding certainly suggests caution in interpreting the results for the Job 
Search only program. 

Prior Employment. As indicated in Chapter 3, the programs 1 
impact on employment and receipt of welfare differed according to whether 



172- 

238 



TABLE 5.10 



SAN 0IE60 

E8TINATE0 BENEFITS AND COSTS PER EXPERIMENTAL AFTER FIVE YEARS, BY RE8EARCH GROUP, ACCOUNTING PERSPECTIVE, 

ASSISTANCE CATE60RY ANO APPLICATION PERIOO 



7 T 





Job Search - EWEP 


Job Seeroh 


Coaponent of Analysis 


Sod el 


Accounting Perepectlve 
Appl 1 cent 


Texpey er 


8ocl el 


Acoountlng Perepectlve 
Appl 1 cent 


Te xpe /er 


AFOC 

October 1882-Merch 1883 
Banef 1 ta 
Coete 


•28 92 
-841 
2061 


11042 

17 
1058 


• 1850 
-857 
983 


•4008 

-538 
3470 


• 2352 
25 
2377 


• 1857 
-583 
1084 


April 1983-Auguet 1883 
Barter 1 te 
Coete 


2303 
-587 
1718 


343 
16 
359 


1980 
-603 
1357 


-3234 
-524 
-3758 


-3032 
28 
-3004 


-202 
-552 
-754 


AFOC-U 

October 1882-Merch 18B3 
Saner 1 te 
Coete 


11833 

-724 
BOB 


-•752 

23 
-729 


• 23 84 

-747 
1837 


• 858 

-586 
280 


-•536 

32 
-504 


• 1390 
-588 
782 


April 1983-Auguet 1883 
Boner 1 te 
Coete 


254 
-88B 
-434 


-1888 
17 
-1B79 


184B 

-705 
1243 


355* 
-538 
-184 


-2177 
28 
-2149 


2532 
-5B6 
18B4 



SOURCES i MORC oelouletlone froa Unemployment Ineurence recorder AFOC deter epplloent eurveyi eorkelte eurveyi EPP 
Inforaetlon Syetea enrollment deter EPP, EWEP, WIN and JTPA progrea coet recorder and publlehed dete on eetfero coete, tex 
retes, end eaployee fringe beneflte. 8ae text for daeorlptlone or these eourcee. 

N0TE8I Coaponente ere lleted ee benefits or ooete eocordlng to a priori expectetlone regerdlng their value froa the 
eoclel perepectlve* However, the reeulte preeented reflect eotuel outcoaee, not expectetlone. Poeltlve eaounte Indloete e 
beneMti negetlve eaounte Indlcete e coet. All benaflte end ooete ere eetlaeted for e Mve-yeer tlae horizon beginning it 
eppllcetlcn, end ere expreeeed In 1883 dollers. Beceuee or rounding, detell aey not eua to totele. 



239 



ERIC 



applicants had recent employment experience. Given this evidence, the 
benefit-cost analysis has been disaggregated according to the same 
criterion used in that chapter: whether or not an applicant had been 
employed in the year prior to application for welfare. The results are 
presented in Table 5.11. 

For the AFDC assistance group, the disaggregated results indicate that 
both programs were more effective in serving applicants without prior 
employment. From the social perspective the Job Search program generated a 
net present value that was almost $800 higher per applicant without prior 
employment than for those with it. The addition of 3WEP had an even more 
dramatic effect on applicants who had no recent work experience. The 
social net present valiro of the Job Search/EWEP program was about $2,000 
higher for an applicant in this group than for one with experience. 
Although in both cases costs were slightly higher for the inexperienced 
group, the programs had a much greater net impact on the employment of this 
group, which generated substantially greater social benefits. Moreover, 
these additional benefits accrued to both applicants and taxpayers. 

The finding that the effectiveness of programs designed to increase 
the employment of welfare applicants varies according to previous 
employment in understandable since those who are least employable may 
reasonably benefit most from intervention. in particular, it is logical 
that providing work experience is most ef^ tive for those who have none. 
The magnitude of the difference is noteworthy: Job Search produced more 
than twice as much net social value for the inexperienced group and Job 
Search/EWEP generated more than than three times as much value. 

AFDC-U applicants who had no work experience in the last year 
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TABLE 5,11 
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represent a small group that, given the eligibility requirements of the 
AFDC-U program, did have a history of prior employment. 2 * 1 Disaggregating 
findings according to this criterion indicates greater transfer reductions 
for the applicants in both programs who had not worked in the last year, 
thus producing larger gains for taxpayers. From the social perspective, 
disaggregation by history of prior employment produced a smaller 
difference. 

3. Sensitivity of the Results 

As has been noted several times in this chapter, the benefit-cost 
analysis incorporates many assumptions. However, the sensitivity of the 
overall results to changes in key assumptions used in the analysis has been 
systematically tested. The results of the tests, which are presented in 
detail in Appendix F, indicate that although the dollar estimates are 
indeed sensitive to some of the assumptions, the benefit-cost conclusions 
do not change. 

The results are most sensitive to the assumption that displacement 
does not occur as a result of the increase in employment due to these 
programs. If there is substantial displacement, the net present value of 
the program declines for taxpayers (who include the displaced workers) and 
society as a whole; the value to applicants is unaffected. However, none 
of the conclusions change unless at least one-fifth of the increased 
employment causes displacement, and even then only the net present value to 
society of Job Search for AFDC-U applicants changes — from positive to 
negative. The results from other perspectives and for other groups change 
only if more extreme displacement assumptions are made. 

The way in which program outcomes were estimated also had a relatively 
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large effect on the benefit-cost results. For reasons discussed earlier in 
this chapter, the estimates of program effects used in the benefit-cost 
analysis were unadjusted experimental-control differences in outcomes for 
the entire observation period, not the regression-adjusted estimates for 
fixed follow-up periods reported in Chapters 3 and 4. However, if 
regression-adjusted estimates of earnings and welfare reductions are 
substituted, the net present value estimates change by between $77 and $634 
per experimental, depending on the group and perspective. Most notably, 
for AFDC applicants, the social net present value increases for Job 
Searoh/EWEP and decreases for Job Search alone, which means the net value 
of adding EHEP becomes higher. Also, for AFDC-U applicants, the 
substitution reduoes estimates for Job Search/EHEP and increases them for 
Job Search, making even more substantial the negative value of the addition 
of EHEP for that group. 

The other assumptions are less crucial to the conclusions. Not 
extrapolating benefits substantially reduces most net value estimates, 
while extending the time horizon for extrapolation from five to eight years 
substantially increases them. Substituting other assumptions — such as 
using alternative decay rates for extrapolation — leads to large changes 
in sane, but not most of the findings; the overall conclusions remain the 
same. 

4. Budgetary Analysis 

One particularly important concern for policymakers is the net effect 
of social programs on government budgets. While the programs have direct 
costs, they also generate cost savings for other programs as well as 
additional tax revenues. The effects of these costs, savings and revenues 
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on budgets are different for federal, state, and local (county and city) 
levels of government. This section of the chapter assesses the budget 
effects of EPP and EWEP. 

All the benefits and costs included in the taxpayer perspective except 
the value of EWEP output affect government budgets. Increases in tax 
payments contribute to federal, state and local revenues. Reductions in 
transfer payments and administrative costs, as well as in the use of WIN 
and JTPA by experiment*^, decrease the expenditures required for those 
programs. EPP and EWEP expenditures affected government budgets at all 
levels. 

In order to assess budgetary impacts on different levels of 
government, all pertinent benefits and costs have been allocated between 
the budgets of federal, state and local government, taking into account 
sources of funding, matching arrangements, and tax regulations in force at 
the time of the demonstration. For example, the program costs charged to 
the special federal demonstration grant that funded more than half of EPP 
operations were divided evenly between federal and state budgets, while 
regular WIN funding from the federal government — which requires only a 10 
percent state match »- was allocated accordingly. Another important 
component of the budgetary impact, reductions in AFDC payments, was 
allocated between the federal, state and local levels according to matching 
requirements for AFDC payments (in most cases, 50 percent federal, 45 
percent state, and 5 percent county); savings in AFDC administrative costs 
generally were distributed slightly differently (50 percent federal, 25 
percent state, and 25 percent county. J 1 * 2 

The resulting breakdown of budgetary gains and losses by level of 



-178- 



24i 



government is presented in Table 5-12. As indicated in the table, the 
federal government shouldered most of the burden for program costs through 
its grants for EPP and EWEP and its regular WIN funding. However, the 
federal government also received the largest share of benefits. It 
reoeived most of the increased tax revenues, because most of the increase 
was in federal income taxes and Social Security payroll taxes. It also 
gained about half of the APJC savings and the largest share of savings from 
other transfer programs, because it covers most of MediCal payments, and 
all Food Stamp benefits. The federal government was also the principal 
beneficiary of other program savings, notably from WIN. Consequently, the 
net federal budgetary effect was clearly positive: the gain ranged from 
$430 to $636 per experimental depending on the group served. 

The State of California paid less for the program — its WIN funding 
match and EPP grant match plus some support service costs. The State also 
received smaller budgetary gains than the federal government; gains for the 
State included state income and sales tax revenue, almost half of the AFDC 
savings, and large savings from the DI and MediCal programs. As a result, 
California had a net budget gain of between $3 and $553 per experimental. 

It is noteworthy that the budgetary effects were modest at the local 
level — the level at which the programs were operated. The County of San 
Diego bore a small part of the overall program cost, including a portion of 
the EWEP grant and part of the support services costs. In return, San 
Diego received a small amount of tax revenue (its share of sales taxes), 
AFDC savings and other program savings. However, the city and county were 
the primary beneficiaries of EWEP labor services, a benefit that does not 
enter this budgetary assessment. Approximately 60 percent of the 
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estimated value of these services accrued to city and county agencies, 
while the remainder went to state agencies and nonprofit organizations in 
the San Diego area. 

The timing of the budget costs and gains merits attention. Although 
all of the costs were incurred during the observation period — most within 
the first few months after application for welfare — the budget gains 
oocurred throughout both the observation period and the post-observation 
period covered by the analysis. Indeed, the costs incurred at all three 
levels of government were not offset by gains within the observation period 
for most of the groups served, while the costs were easily surpassed over 
the longer five-year time horizon. This pattern of budgetary impacts after 
the observation period is based on the fact that the programs generally 
make a difference in the employment of participants only after they have 
participated in the program — and there is a further lag until gains in 
employment are translated into increased taxes and reduced welfare 
reoeipt. Moreover, due to MediCal regulations, the programs 1 effect on 
MediCal benefits takes place only after individuals have been off the 
welfare rolls for several months. 

The fact that these budgetary effects reflect the funding arrangements 
and matching requirements present at the time of the demonstration is worth 
underscoring. Changes in these parameters would clearly change the budget 
iL^ots, For example, if the special federal demonstration grants that 
paid for more than half of the operating costs had not been available, and 
had California paid these costs out of state funds, the net effect on the 
state budget would have been negative. Thus, federal involvement in the 
funding of EPP and EHEP was important to the budgetary findings of this 
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assessment. 



E. Conclusions 

Several Important conclusions emerge from this benefit-cost evaluation 
of Job Search and Job Search/EWEP. First, from the standpoint of taxpayers 
both programs consistently provided a substantial return on the investment 
that was required regardless of the group of welfare applicants being 
served or the time they entered the program. The size of the investment — 
between $560 and $727 per experimental — was relatively modest. The 
return came in the form of EWEP labor services in the short-term and small 
but steady reductions in the use of transfers and program services and 
increases in tax payments over the five-year period covered by the 
analysis. It is worth underscoring that, as explained in the previous 
section, much of the return occurred well after the initial investment. By 
the end of five years, however, taxpayers had received an estimated $452 
to $1414 more in benefits per experimental than their investment. This 
resulted in budgetary gains at all levels of government — federal, state 
and local — for both programs. 

In contrast to the finding that taxpayers benefit from both programs, 
the findings for welfare applicants show increases in financial resources 
for some applicants and losses for others. AFDC applicants assigned to Job 
Searob/EWEP, especially those with no recent employment received 
considerable financial benefits. Net income definitely increased for early 
AFDC enrollees in Job Search as well. However, AFDC-D applicants in both 
programs and later AFJ)C enrollees in Job Search were worse off than their 
counterparts in the control group. 4 Hiese negative results for applicants 
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partly offset the consistently positive findings for taxpayers — leaving 
the social net present value highly positive for AFDC applicants in Job 
Search/EWEP and somewhat lower for those in Job Search. Society more or 
less broke even with both programs for the AFDC-D applicants. 

These findings suggest that these program models are promising, 
although consideration of program modifications and targeting strategies is 
warranted. For example, work experience appears to be much more effective 
for people who did not have recent work experience prior to applying for 
welfare, suggesting that they be given priority in programs that provide 
work experience. Similarly, varying the length and content of job search 
workshops according to economic conditions and the types of applicants 
being served may be desirable. 

Finally, while most of the general conclusions of this analysis can be 
drawn with a reasonable level of confidence, the dollar estimates that have 
been made should not be regarded as precise. One of the reasons for this 
is the normal uncertainty surrounding the point estimates included in the 
analysis,, This reflects not only statistical concerns, but also 
measurement error due to data problems and other issues. Another reason is 
the fact that numerous assumptions have been required for the analysis. 
Benefit and cost estimates are sensitive to some of the key assumptions, 
although the general conclusions of the analysis appear to hold regardless 
of the specific assumptions made. Finally, many benefits and costs of EPP 
and EWEP could not be included in the analysis. Notable among these 
intangible factors are the satisfaction and self-esteem gains to 
participants from holding EWEP and regular jobs, and the reduction in time 
available to participants for parenting due to holding these jobs. Despite 
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these limitations, the analysis provides important evidence regarding the 
programs* overall effectiveness, as well as the pattern of its financial 
consequences for welfare applicants and government budgets. 
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TABLE A.1 



SAN OIEGD 

AFOC APPLICANTS: SELECTED CHARACTERISTICS OF THE RESEARCH SAMPLE 
AT THE TIME OF WELFARE APPLICATION, BY RESEARCH GROUP 
[OCTOBER 19B2 - AUGUST 19B3 SAMPLE] 



Cherecterl stl c 


Job Search- 
EWEP 


Job Seerch 


Control 


Avaraga Age (Years) 


33.6 


33.6 


33. B 


Sax (%) 
Male 
Female 


15.6 
B4.4 


14.6 
B5.4 


16.7 
B3.3 


Ethnicity (%) 

White, Non-Hi spani c 
Black, Non-Hi apani c 
HI 8pan1 c 
Other 


56.6 ' 
20. D 
1B.8 
4.6 


59.2 
1B.B 
17.5 
4.6 


55.2 
23.0* 
17. B 
4.1 


Marital Status (%) 
Never Married 

Married, Living With Spouse 
Merrled, Not Living With Spouse 
Divorced, Widowed 


14.1 
12.4 
36.6 
37.0 


16.5 
13.2 
34.0 
36.4 


19.0*** 
13.7 
29.9*** 
37.4 


Averege Number of Children Under 
1B Years of Age 


1 .73 


1.73 


1 .76 


Prior AFOC Dependency (%) 
never on Mruu 
Two Yeers or Lees 
More Than Two Yeers 


34. B 
3B.3 
26.9 


33.7 
39.2 
27.2 


31 .B 
39.6 
28.6 


Held Job at Any Time During Four 
Quarters Prior to Application [%] 


51 .3 


52.6 


50.6 


Averege Eernlnge During Four Quarters 
Prior to Appllcetlon (•) 


2602. 9B 


2701 .22 


2643. 1B 


b 

Totel Semple 


16B7 


943 


961 


SOURCES Celculetlone from MORC Client Informetlon Sheets end UI eernlnge 
recorde from the EPP Information System. 

NOTES: Dietrlbutlona mey not edd exectLy to 100.0 percent because of 



ERIC 



roundl ng. 

a Celculeted from Unemployment Ineurence eernlnge recorde from the 
Stete of California. 

b For aelected cherecterl stl cs, eemple elzee mey very up to six 
sample points due to missing date. 

Dlfferencea among the three reeeerch groupe were ste 1 1 st 1 ce I Ly 
elgnlflcent uelng e two-telled t-teet or ch1-equere test et the following 
Levels: * - 10 percent; ** * 5 percent; *** - 1 percent. 
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TABLE A. 2 



SAN OIEGO 

AFOC-U APPLICANTS! SELECTEO CHARACTERISTICS OF THE RESEARCH SAMPLE 
AT THE TIME OF WELFARE APPLICATION, BY RESEARCH GROUP 



(OCTOBER 19B2 - 


AUGUST 18B3 


SAMPLE) 




Character 1 st 1 c 


1 

Job Search- 
EWEP 


J ob See rc h 


Co n t rn 1 


Average Age (Years) 


31.2 


31.0 


31.1 


Sex (%) 
Male 
Female 


B3.1 
B.8 


93.3 
6.7 


92.6 
7.4 


Ethnicity (X) 

Wh1 te» Non-Hi spanl c 
Slack* Non-Hi spanl c 
HI spani c 
Other 


54.5 
7.B 

32.6 
5.0 


51.6 
9.B 

33.5 
5.1 


52.4 
B.7 

33. B 
5-1 

W.I 


Marital Status (X) 
Never Harried 

Herrledt Living With Spouse 
Married, Not Living With Spouse 
Divorced, Widowed 


7.3 
B8.6 
1.4 
1.7 


6.6 
60.4 
1.4 
1.6 


6.3 
B9.0 
2.2 
2.5 


Averege Number of Children Under 
19 Years of Age 


2.12 


2.10 


2.1B 


Prior AFDC Dependency (X) 
Never on AFOC 
Two Years or Less 
More Than Two Years 


5B.4 
36.0 
5.6 


59.1 
35.6 

S A 


57.9 
36.4 

Dm/ 


Held Job at Any fine During Four 
ttuerters Prior to Application (X)" 


71. B 


71.2 


s 

71.0 


Average Earnlnga Ourlng Four duerters 
Prior to Application ($) 


6585.50 


6032.25 


6133.50 


b 

Total SempLe 


154B 


635 


623 



SOURCE] Calculatlone from MORC Client Information Sheets and UI earning 
records fro* the EPP Information System. 



NOTESi Distributions may not add exectly to 100.0 percent because of 
roun d1 ng. 

a 

Calculated from Unemployment Insurance earnings records from the 
Stote of California. 

b 

For aelected cheracterl stl cs, aample sizes may very up to three 
sample points dua to missing date. 

None of the differences emong the three research groups are 
statistically algnlflcant at the 10 percent level using e two-te1led t-teet or 
ch1-squere test. 
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APPENDIX B 
SPECIAL DATA COLLECTION STIinTflS 



This appendix will discuss the special data collection studies which 
enhanoe the analysis described in this report, 

1* The Worksite Survey administered by MDRC provides information 
on the types and characteristics of EWEP jobs and the percep- 
tions of participants and their EWEP supervisors about the 
worksite experience. These data will also be used to address 
issues such as the quality of the worksites and the value of 
the output produced by participants. The results are based on 
a random sample of 49 supervisors and 49 EWEP participants, 
interviewed between July 19 83 and March 1984, 
2. The Six-Month Add I leant Survey was conducted either in person 
or by telephone over a period of six months after welfare 
application. It provides information on sample members 1 first 
jobs, particularly average weekly hours and hourly wage rates, 
occupational titles and job retention, participation patterns 
in job search and EWEP, child-care arrangements, and income 
sources other than employment. (Information on these 
additional sources of income is crucial to the benefit-cost 
analysis. ) 

For this six-month survey, a randan sample was taken from 
all three research groups, which together included 4,337 
people who had applied for welfare from January through July 
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of 1983. The random sample contained 2 , 867 (or 66 percent) of 
these applicants. About 65 percent of this sample were 
located and interviewed. The response rate was similar in 
each research group. However, characteristics of respondents 
differed from those who did not respond; respondents were more 
likely to have participated in a program activity or to have 
found employment. For more information on survey procedures, 
response rates and any possible response bias, see Appendix B 
of Goldman et al. , 1985. 

3* A Case F ile Study administered by MDRC during the spring of 
1984 examined a random subsample of 211 Job Sear ch/ EWE P experi- 
mental registrants who applied for welfare during March and 
April 1983 tudy used a number of different files 

those of th Maintenance District, EPP and EHEP « to 

obtain a br* *ange of Information on sample members 1 pro- 
gram experiences assignment to activities, noncompliance (if 
any) with these assignments, staff follow-up of noncompliant 
sample members and the results of this follow-up, including 
program deregistration or the imposition of a sanction. This 
case file study provided the data used in the discussion of 
the implementation of a mandatory participation requirement in 
Chapter 4, Goldman et al., 1985. 

J». Ongoing Observation s of EP P and EWEP Operations . Direct 
observation of program activities, interviews with staff and 
recipients, and limited reviews of local office case files 
were all used to study current program activities for the 
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process analysis. The field researcher, assisted by other 
MDRC staff members, collected the qualitative and quantitative 
data for this analysis. 
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TABLE C.1 



6 AN DIBGO 



NINE- NO NTH PERFORMANCE INDICATORS FOR APPLICANTS, 
BY RESEARCH GROUP AND ASSISTANCE CATEGORY 
(OCTOBER 1882 - AUGUST 18B3 6AMR.E) 





1 

AFOC 


I 

AFOC-U 


Nina-Month Performance Indicator 


Job Search- 
EWEP 


Job Search 


Control 


Job Search- 
EWEP 


Job Seerch 


Control 


Job Plecement Aaeletence [X] 


88.2 


90.8 


0.0*** 


89.8 


89.1 


0.0*** 


Reg 1 it e red With EPP/WIN IX] 


66.1 


88.6 


87.2 


86.2 


87.0 


89.7** 


Participated in Any Poet- 
Registration Activity [X] 


46.4 


48.8 


6.1*** 


52.8 


49.5 


5.4*** 


Participated at Least 
One Oay In Job Search 
Workshop [%] 


44.1 


46.6 


0.8*** 


51.6 


49.3 


1.0*** 


Worked at Least One Hour at 
an EWEP Workei te [X] 


13.0 


0.0 


0.0*** 


16.7 


0.0 


0.1*** 


Received Other 
EPP Services [X] 


4.6 


5.1 


5.4 


3.3 


4.1 


4.4 


Program Placenent & 
(Founo Employment) [X] 


28.4 


27.6 


16.5*** 


34.0 


33.2 


21.2*** 


Deregl stored From EPP/WIN [X] 


60.6 


58.1 


52.0*** 


68.1 


65.3 


60.3 


Oue to Request 
Far Sanction [X] 


8.0 


6.7 


0.7*** 


6.3 


4.4 


1.1*** 


b 

Total Applicants 


1540 


867 


889 


1403 


855 


836 



SOURCES MDRC celculetlone fro* the EPP Information System and EWEP Activity Logs melntelned by the Sen 
01 ego County Department of Boclel Services. 

NOTES: All performance Indlcatora are celculeted ae e percentege of elL Impact eempLe Members In the 
Indlceted raaaarch group. 

"progrem pleceaent Information Is based on employment thet Is reported to progrem staff. Program 
placement dete mill not be ueed to maaaure Impacts. 

Excludes eppllcents mleslng AFOC peyments for et laeet one month within the first elx months of 

application. 

Differences between reeeerch groups within sn aeelatence cetegory ere stetletlceLLy elgnlficent 
using a two-teUed t-test at the following levelas * * 10 percent} ** * 5 percent} *** ■ 1 percent. 
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TABLE C.2 



SAN DIEGO 

DISTRIBUTION DF EPP REGISTRANTS BY PROGRAM, WELFARE AND EMPLOYMENT STATUS . 
IN THE NINTH MONTH AFTER WELFARE APPLICATION, BY RESEARCH GROUP AND ASSISTANCE CATE60RY 

(OCTOBER 1982 - JUNE 1983 SAMPLE) 

I i 





AFDC 


AFDC-U 


Ifare Status 


Job Search- 
EWEP 


Job Search 


Control 


Job Search- 
EWEP 


Job Search 


Control 


f Wei faro 


55.2 


54.1 


51.9 


e?.s 


63.4 


56.0 


calving Welfare, 
regl stared 


22.4 


18.7 


16, ,7 


18.7 


16.4 


17.5 


celvlng Welfare, 
g1 aterad 


22.5 


27.1 


31.3 


14.8 


18.2 


£3,8 


Completed Raqul resent a 


10.2 


16.2 


2.5 


7.1 


12. r 


1.7 


Eaployad, and Did Not 
Complete Raqul rwanta or 
Never Participated 


3.1 


2.1 


5.1 


1.1 


0,7 


5.2 


Unknown, Did Not Complete 
Rsqul reaenta or Never 
Participated 


8.0 


8.B 


23 fl 


6.2 


5.5 


16. S 


tel Registrant? 


118D 


678 


683 


1D67 


685 


687 



SOURCE £ HDRC calculations froa the HPP Information Systea, County of Sen Diego welfare records and 
inployaant Insurance records. 

NOTES: Distributions aay not sua to totals because of rounding. 

Pert1c1pet1on 1a defined ee ettendlng any service/activity for at laaat one day. 

Teeta of statistical significance vera not calculated, 
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TABLE C.3 



SAN DIBSO 



AFDC APR. I CANTS I SIX- MONTH PERFORMANCE INDICATORS, 
BY RESEARCH GROUP ANO APR- 1 CAT ION PERIOD 
(OCTOBER 1882 - AUGUST 1863 SAMPLE} 



six nonin rariDniBnvi inui witur 


Job Beerch-BIEP 


Job Search 


ucbuDsr looc 

lt*r>r>h 1 QOT 

rarcn istu 


MUgUVb IDOO 


Dctnhar 1 QRP — 
Ifarch 1BR3 


Aprl l- 
AuauBt 1fi83 


Contact ari Wnrkar For Job PLaceaent 










Aerlatonco (X) 


QQ 4 
Deal 


PR R 
DD.D 


B1 0 

O 1 .u 


80.0 


Referred to a Job 




O.c 


a n 


J 5.R 




n n 


n n 




0.0 


Rani star ad Ml th EPP t%) 


65 .7 


65.2 


ess 


64.7 


Participated In Any Poat-Raglatratlon 










Activity (X) 


43. B 


45.B 


46.2 


48.8 


a 

Parti clpattd In Job Search Workehop [X] 


41.1 


43.8 


43.6 


46.3 


Found Employment During Workehop 


8.7 


12.3 


13.0 


14.0 


Completed Workehop, Not EmpLoyed 


23.8 


23.4 


21 r 6 


24.8 


Did Not Complete Workehop 


7.5 


8.2 


8.0 


8.3 


BIEP txj b 










Referred to BUEP 


22. B 


21. B 


0.4 


0.0 


Interviewed by BtfEP Staff 


17.0 


15.6 


0.2 


0.0 


Assigned to Worksite 


15.3 


13.8 


0.0 


0.0 


Worked at Least One Hour et Worksite 


12.B 


10.3 


0.0 


0.0 


Received Other EPP Services (X)° 


4.8 


3.0* 


5.5 


3. 


Deregletered From EPP (X) 


52.4 


51.7 


48.6 


47.0 


Due to Request for Senctlon (X) 


6.B 


B.2 


6.2 


4.7 


d 

Program PLecement (Found EapLoyaent) (X) 


23.8 


2B,0* 


24.8 


25.8 


Totel Applicants" 


807 


833 


546 


321 



SOURCE: MDRC caLculetlone frosi the EPP Information 8ystec* and STEP Activity Logs. 

NOTES I ALL performance Indicators ere ceLcuLated as e percentage of ill eppLlcents In the 
Indicated raeeerch group. 

"participation Is defined es attending e workehop for et Least one day. 

[continued] 
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TABLE C.3 (continued) 



b 

Information on EtfEP activity 1b obtained from BtfEP Activity Logs Maintained by the San 
Diego County Department of Social Services. Ae compered to the other 1nd1cetore 9 BtfEP Log dete provides 
ollghUy leee poet-oppllcotlon follow-up for Indlvlduele epplylng during the letter pert of eny 
partlculer month, 

Dther EPP eervlcee Includes On-the-Job Tre1n1ng 9 eubeldlzed employment, Indlvlduel Job 
eeerch 9 end WIN Work Experience, 

d Program placement Informetlon 1e beeed on employment that 1e reported to program eteff. 
Program placement dete mill not be ueed to meeeure program Impects. 

"Excludes eppllcante mlaelng AFDC peymente for et leeet one month within the flret elx 
months efter eppllcetlon. 

Differences between epplloatlon perlode within e reaaerch group are stetletlcelly 
elgnlflcent using a chl-aquare teet et the following levels: * » 1D percent! ** c 5 percent; 
s 1 percent. 
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TABLE C.4 



SAN OXBBO 



AFDC APPLICANTS! ATTBi DANCE ANO COMPLETION DATA FOR JOB SEARCH WORKSHOP PARTICIPANTS, 
BY RESEARCH GROUP AND APPLICATION PER IOO 
[OCTOBER 1982 - AUGUST 1983 SAMPLE] 





Job Search - EWEP 


Job Search 




October 1982- 


April- 


October 1962 - 


Aprll- 


Indicator 


Merch 18G3 


Auguat 1883 


March 1883 


Auguet 1883 


Days Attended (%) 


* 








1 to 5 Oaya 


13.3 


15.9*** 


17.8 


16.5 


6 to 10 Oaya 


17.8 


38.5 


84.4 


88.7 


11 to 15 Oaya 


B7.1 


43.8 


54.6 


46.1 


16 Oaya or More 


1 ./ 


4 A 


O .1 


no 
u • □ 


Ivipim Tntal flaws Atfcanditd 


11.8 


8.6 


10.4 


8.8 


Avaraga Total Oaya Exoueed Abeence 


1.8 


1.1 


1.8 


1.0 


Avaraga Total Oaya Unexcuaad Abaance 


0.5 


0.5 


0.4 


0.4 


Outoome of Job Saarch Workohop 










Participation (%) 










Found Employment During Workohop 


83.7 


86.0 


30.5 


88.6 


Completed Workahop, Not Employed 


58.4 


53.4 


49.6 


50.6 


Did Not OMplata Workahop, 










May Ba Raachadulad 


5.8 


8.5 


18.8 


8.8 


Did Not Complete Workahop, 










Not Raaohadulad 


11.1 


8.1 


7.6 


8.8 


Total Nuabar Who Participated 










At Laaat One Pay 


414 


896 


868 


168 



SOURCE t MDRC oelculetlone from the EPP Infnrmetlon Syetcm'e Job 8earch Workahop Attendance Logo. 

NOTES: Theaa date Include only thoaa regletrenta mho participated In a Job Beared Workahop for at 
leaet one dey althln olx monthe of oppllootlon. All Indlootore are oelculeted ee e peroentege of ell 
partlolpante In the Indlceted reeearch group. 

Dletrlbutlone aiey not edd exectly to 100.0 peroant baceuee of rounding. 

"outcome '* workshop participation la baaed on employment etetue reported to progrma ateff 
at the time an Indlvldu . leaves the morkahop. 

Olfferencee between epplloetlon perlode mlthln e reeeerch group ere otatletlcelly 
eigrilfloanl ualng a tan-tailed t-teet or ohl-equere teat et the following levelei * = 10 percent; « 5 
percent* B 1 percent. 
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TABLE C.5 



BAN DIE80 

AFDC APPLICANTS I 8 ELECTED CHARACTERISTICS OF EXPERIMENTAL 8, 
BY J08 8EARCH H0RK8H0P COMPLETION STATUS AND RE' EAR CH 8R0UP 
(OCTOBER 1882 - AU8U8T 1983 8AMPLE) 





Horkehop Coaplotere 
Without e Job 


Horkehop 


Non-Coepl e tere" 




Job Beerch- 
EHEP 


Job 8oerch 


Job 8eerch- 
EHEP 


Job Beerch 


Averege Age (Yeere) 


88.8 


33.6 


83.8 


33.5 


6>x [%) 
Mala 
Faaolo 


18.8 
80.8 


12.7* 
87.8* 


14.6 
85.4 


14.5 
85.6 


Ethnicity (X) 

White, Non-H<epen1c 
Block, Non-Hi epenl c 
HI epenl c 
Other 


84.4 
88.1 
18.5 
4.D 


51 .5 
87.8 
17.6 
2.8 


57.8 
17.4 
2D.1 
4.6 


61.8 
16.3 
17. D 
4.8 


Any Children (X)" 

ft ▼ L. _ _ at W . _ 

Leee Than 6 Yaara 
Betaeon 6 and 18 Yaara 


18.8 
81 .5 


11 .3 
94.1 


18.2 
86*0 


20.5 
86.0 


Prior AFDC Dapandancy (X) 
Never on AFOC 
Tao Yeere or Leee 
Mora Than Tao Yeere 


88.5 
40. 1 
87.4 


89.4 
40.7 
29.9 


35.0 
37.4 
27 .5 


34.4 
88.1 
27 .5 


Averege Montha on AFOC Ourlng Tao 
Yaera Prior to Application 


6.1 


7.0 


6.1 


6.1 


Average Earnlnge During £our Quertere 
Prior to Appllcetlon (I) 


8608.86 


27 37.95 


2467.28 


2652.80 


Held Job et Any Tlae During Four fe 
Quertere Prior to Applloetlon (X) 


51 .5 


50.5 


51.6 


52.8 


Ever Received Uneaployaent 
Coapeneetlon In the Querter 

Prior to Appllcetlon (X) 


13.1 


B.8 


10.4 


10.7 


Averege Aaount of Uneaployaent 
Coapeneetlon In the Querter 

Prior to Applloetlon (I) 


188.23 


83.28 


88.80 


82.27 


d 

Totel Beaple 


375 


8D4 


1165 


683 



BOURCEl Celouletlone froa NORC CMont Interaction dhette, Job Search Horkehop Attendence Loge, end 
UI eernlnge recorde froa the EPP Inforaefclcn Syetea, en£ UI beneflte recorde froa the *tite of 
Cal If ornl a. 

N0TE8 I Dletrlbutlone aey not odd exeotly to 100.0 percent beceuee of rounding. 



thi 



Dletrlbutlone BLy not edd to 10D.0 percent beceuee eppllcente oen heve children In aore 
ory. 



aleelng dete. 



Celculeted froa Uneaployaent Ineurenoe eernlnge recorde froa the EPP Inforaetlon Syetea. 
Celculeted froa Uneaployaent Ineurenoe beneflte recorde froa the Btete of Cellfornte, 
For eelected cherecterl etlce, eeaple elzee aey very up to four eeaple polnte due to 
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Non-ooapletere ooaprlee thoee Job Beerch Horkehop pertlclpente aho ended the aorkehop alt 
e Job, end thoae aho did not coaplete the aorkehop beceuee they dropped out or never per tl c I pa ted. 

Dlfferenoee between reeeerch groupe althln e Job eeerch aorkehop etetua are ete tl et I ce I ly 
algnlflcant ualng a tao-telled t-teet or ohl-equere teet et the folloalng Leveies • « 10 percent! » 5 
parcanti » 1 percent. 
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BEST COPY AVAILABLE 



TABLE CB 



SAN DIBGO 



AFOC APPLICANTS! IMPACTS OF EWEP ADD-ON FOR JOB SEARCH WORKSHOP 
COMPLETERS WITHOUT A JOB » BY APPLICATION PERIOO 
(OCTOBER 1988 - AUGUST 1983 IMPACT SAMPLE) 



Job 8eerch-B(EP/Job Starch Difference 



T 



T 





October 1882 - 


Apr 11- 


October 1982- 


Out com e end Foil or- Up Quarter 


Merch 1983 


Auguet 1683 


Auguet 1883 


Ever Employed) Quertere 2-8 [X] 


+18.5** 


+ B.8 


+10.8** 


Averege Nueber of Quertere with 










n OB 




• no ja a 


Ever Employed (X) 








Querter of Application 


+ 3.8 


+ 3.0 


+ 3.5 


Quarter 8 


- 1.7 


- 8.8 


- 1.9 


Querter 3 


+ B.3 


+10.8 


+ 8.0** 


Querter 4 


+ 4.3 


+ 7.1 


+ 5.5 


Querter 5 


+13.3** 


+11.1* 


+18.4*** 


uuerter t> 


+ D.B 


+15.B** 


+ 9.9** 


Averege Totel Eernlnge, 








Quertere 8 - 8 it) 


»D Dl iCC 


" *fO/ |Ol 




Averege Totel Eernlnge (I) 








Quarter of Applcetlon 


- 1.83 


- 38.59 


- 16.83 


Quarter 8 


- 14.40 


+180.78 


+ 48.47 


Quarl*r 3 


+ B9.B6 


+253.57 


+146.81 


Querter 4 


+185.38 


+894.87* 


+195,43* 


Querter 5 


+317.70** 


+348.57* 


+3S9.47*** 


Him pi + ai n D 

uuercer o 


+ 88.89 


+448.58** 


+833.88* 


Averege Nueber of Mentha Receiving 








AFDC Peveiente. Quertere 1 — B 

Hrwu r»j«nn«i| HUD I bo I o I d 


-fl no 


— fl AD 


U .1 o 


Ever ReoeWed AFDC Peyeente (X) 








Quarter of Application 


-4.5 


-0.9 


- 3.0 


Querter 8 


-1.8 


-8.5 


- 8.4 


Owner 3 


+8 .8 


+8.7 


+ 8.3 


Querter 4 


+4.7 


-G.0 


+ 1.5 


Querter 5 


-1.0 


-1.8 


- 1.1 






U a 3 


•4. n q 

r U.D 


Averege Totel AFDC Paynente Received, 








Quertere 1 - 6 (t) 


-889.04 


-74.30 


-186.89 


Averege AFDC Peyeent Received (!) 








Querter of Application 


-18.43 


-46.78 


- 86.09 


Querter 8 


-64.69 


+51.84 


- 1B.01 


Querter 3 


-€7.89 


- 7.47 


- 43.80 


Querter 4 


-65.81 


- 6.50 


- 37.18 


Querter 5 


-31.43 


-85.39 


- 33.85 


Querter B 


+ 8.98 


-e7.es 


- 9.57 


Nueber of Ooapletere 


338 


837 


566 
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(continued) 



Table C.6 [continued] 



SOURCE ANO NOTESx See Table 3.4. 
b 

Completers without a job comprises those Job Search Workshop participants 
who ended the workshop without e job and were therefore eligible for referrel to EWEP. 

None of the differences In 1 a poets between application periods are 
stetlstlcelly significant at the 10 percent level using e two-tailed t-teet. 



TABLE C.7 



SAN 0IE60 

AFDC APPLICANTS! IMPACTS OP EWEP FOR JOB SEARCH WORKSHOP NON-COMPLETER? • BY APPLICATION PERIOD 

(OCTOBER 1988 - AUGUST 1983 IMPACT SAMPLE] 



Job 8earch-BfEP/Job 8aarch Olffarence 





October 1982 


Apr* i— 


uctooer " 8 Be 


Outcome and Fol low-Up Quarter 


March 19B3 


August 1983 


Auguat 1983 


a 

Ever Employed, Quarters 2-8 [%) 


- 3.3 


M C 

- 1 .5 


_ O R 


Averege Number of Quertera with 








Employment, Quertera 2 - 8 


- 0.02 


+ 0.28* 


+ 0.09 


Ctt^m bill mibJ far 1 

ever employed i*j 








Quarter of Application 


+ 0.3 


4. R 4 
▼ D.I 


4. O A 


Quarter 2 


"3.4 


x n o 


— 4 A 

— 1 .4 


Quarter 3 


"0.2 


JIM 

▼ 4.8 


X 4 D 


Querter 4 


+ 1 .3 


▼ 7.u* 


X O R 


Querter 5 


+ 1 .5 


▼ 4.3 


4. O 7 


Querter 8 


- 1.4 


+ 9.4"yy 


+ 2.8 


B 

AvereQe Tote I Earnings, Quart era 2 — 8 ($] 


jqnn on 


JJOflR 71***vvv 

^iccOi/ 1 yyy 


+005 AO 


Averege Total Eerninge ($] 








Querter of Application 


— AD. OA 

4o .o4 


4- RP OR 
— DOicD 


- R 40 

O . f c 


Quarter 2 


• 7Q DC 


T IDuiOU 111 


+ 19.47 


Querter 3 


—4 47 70 


4-004 RRt^ww 


* IDiUO 


Querter 4 


— Uidc 


+44R R7***vv 
~wiD.o/ yy 




Querter 5 


_ CO 00 

Da ice 


+47R 4R*v 
t i/Ui io j 


+ 35.10 


Querter 8 


— AO 07 
*fo .0/ 


.**c yyy 


•fin? 05 


Averege Number of Monthe Receiving AFDC 








Peymente, Quartere 1—8 


_ n 07 

U.c/ 


— n 4R 
u .1 0 


«- n oa 


Ever Received AFDC Peymente (X] 








Quarter or Applicant ion 


_ Q 0 


4> 0 R 
— c.D 




Quarter 2 


- 2.8 


_ 4 A 

- 1 .4 


— 0 Q 


Querter 3 


+ 0.4 


4.3 


— 4 D 


Querter 4 


- 0.3 


a. n 0 
+ 0.3 


*. n 0 
— u.c 


Querter 5 


- 2.5 


5.1 


_ 0 c 
— 3.D 


Querter 6 


MM 

- 1 .1 


M O O 


— 4 n 


Averege Totel AFDC Peymente Received, 








Quartere 1 - 6 [$) 


-104.83 


-21.40 


- 75.11 


Averege AFDC Peymente Received ($] 








Querter of Application 


-20.83 


•/«7.45<*y 


+ 13.10 


Quarter 2 


-25.58 


-28.74 


- 26.59 


Quarter 3 


-1- 2.34 


-18.38 


- 7.18 


Querter 4 


- 9.88 


-18.12 


- 13.59 


Querter 5 


-19.31 


+ 3.23 


- 10.95 


Querter 6 


-32.01 


-28.85 


- 29.92 


Number of Non-Completera 


1083 


708 


1789 



80URCE AND NOTES t fjM 
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_ee Teble 3*4. 

Non-Completera oomprieee thoee Job Search Workahop participenta mho ended 
the workahop »1th e job, end thoee mho did not complete the morkehop beceuee they dropped out or 
never pertldpeted. -202- doS 



TABLE C.B 



BAN 0IE80 

AFOC APPLICANTS! IMPACTS OF JOB 8EARCH-EWEP ANO JOB SEARCH 
ON LEN8TH OF TIME UNTIL START OF > MPLOYMENT, BY APPLICATION PERIOO 
(OCTOBER 1888 - AUGUST 1883 IMPACT 8AMPLE) 



Outcoaa and Follow-Up Pirlod 


1 

Job Search - EWEP 


Job Siiroh 


Exparlaantal Control Olffaranoo 


Exparlaantal Control Olffaranoo 


Ft rat Caplogad (X) 
Qui r $ t r 8 
Duirtir 3 
Qui r t i r 4 
Quirtir 5 
Quirtir 6 


Ootobar 1888 

9P.8 PR ft *7 

11.8 8.3 4-8.5 
7.8 7 . B +0 1 

4.8 s;s -1.0 
8.3 5.3 -8.0** 


- Mirch 1888 

Q K O OK. m 4.4 n 4 • • • 

7.7 8.3 - 1.6 
7 8 7 K ♦ n 4 
8.3 6.8 - 0.0 
3.6 6.3 - 1.8 


Saapla 81xi 


878 536 


636 636 


First Eaplogad (X) 
Quirtir 8 
Quartar 3 
Quirtir 4 
Quirtir 5 
Quirtir 6 


April - Ai 

SB. 8 89.8 +8- 
10.1 8.6 4-0.6 

6.6 6.5 -1.0 
3.8 5.8 -1.8 

8.7 3.8 -0.6 


JQuot 18B3 

00.0 flg iO ▼ O.U 

B.1 8.5 -1.4 
6.8 6.6 4-0.4 

8.7 6.8 -1.5 

3.8 3.8 -0.0 


Saapla 81zi 


683 33B 


380 338 


Flrit Eaplovad [%) 

Quirtir 9 
Quirtir 4 
Quirtir 6 
Quirtir 8 


Octobir 18B8 

86.8 8B.7 +6.8*** 
11.8 8.4 +1.7 
6.7 7.1 -0.4 
4.5 5.7 -1.8 
8.1 4.5 -1.4* 


- Auguit 1883 

37.8 88.7 +8.B*** 
7.8 8.4 -1.6 

7.3 7.1 4-0.8 
4.7 6.7 -0.8 

8.4 4.5 -1.1 


Saapla 81xi 


1608 873 


65B 873 



80URCE I MDRC oiloulitlom froa Unaaployannt Imurinoi aarnfnga rioordi froa tho EPP 
Infcraatlon 8yatea. 

N0TE8I Thin duti an ragrinlon-idj uitid uilng ordlmry lint iquirn, controlling for 
pri-ippl loitlon ohb?ietir1it1oi of ■■■pli ■■■bin. Thin Bay b* aoaa dl loripinol ■■ In oiloulitlng 
auaa ind dlffaransa* to rounding. 

lapaota through sjv^rtBr 6 vara rigrml on-idj uitid with ■ social thit poolid nrly anB 
lit! ipplloint aaaplaai oocff 1 dante of oontrol virlibln ara oomtrilmd to •quality icron 
oppHoitlon pirlodi. 

*Quirtir 1, thtt qvcrtir s? ipplloitlon, Bay contain aoaa urnlngi froa thi pvrlod prior 
to ipplloitlon ar.d H not 90n&l3ar«d ■ trui follow-up quirtir. "Flrot aaployaont" during follow-up 
1i tharafora oountid itirtlnc < roa quirtir 8. Tha count for quirtir 8 will Inoludi aoaa Indlvlduili 
who in uployid 1n quirtir ^ t 



A two-til lad t-tut aaa applied to dlffirinon betaaan axparlaantal and oontrol group!. 
1 1 * ■ ' • « 10 par cant | « 6 par cant | m 1 percent. 



Statlatlcal ilgnlfloinoi {.aval a ara tndloatad aai 



Nona of thi dlffirmcii In lapacta bataaan application porloda ara atatl atl cal ly 
algnlfloant at tha 10 paroant laval ualng a tao-talltd t-taat. 
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TABLE C.B 



SAN OIE60 

AFDC APPLICANTS! IMPACTS OF JOB 8EARCH~EMEP ANO JOB SEARCH 
ON EMPLOYMENT RETENTION, BY APPLICATION P e .HIOO 
(OCTOBER 1962 - AU0U8T 1883 IMPACT SAMPLE) 





J bp 


Search •* 




Job Seerch 


Outooae end Folloi-Up Period 


mi ■■■ ■ mil' ■- . . •■— 

Expo • lacntel 


Center 


*;i r erence 


Exper laentel 


Control 


01 f f erence 








October 1888 


- Kerch 1883 






c ■no B 


48*3 


64 .3 


-8,1 


47.4 


64.3 


-7.0** 


Not Eaployed In Querter 2» 

fine* Eanl nu iH 4 n Qua ■ ^ 8 
BUS Cip I uy ID in VUlrdr 0 


18*1 


80*0 


-0.9 


18.8 


20.0 


-3.2 


Eaployed 1n Querter 8 but 
Not Ea ployed In Qua rt ■ r 6 


18*8 


8.3 


♦ 2.9 


13.4 


8.3 


♦4.1** 


Eaploy id In Both fiuertere 
2 end b 


20.4 


16.4 


♦4.1* 


22.4 


16*4 


♦6.0** 


Seaple Size 


878 


535 




638 


536 




Percent Mho Morel* 






April - Al 


iQuet 1983 






Not Eaployed 1n Quortoro 
8 and 6 


48 • 7 


50*5 


-7.7** 


48.0 


60.6 


-4.4 


Not Eaployed In Querter 2 


17.5 


16.0 


♦ 1.5 


14.4 


16.0 


-1.8 




18,1 


8.6 


♦ 3.3 


18.7 


6.6 


♦10. 8*** 


Eaployed 1n Both Quortoro 
8 mt d 8 


87.7 


24.8 


+ 2.9 


18.9 


24.8 


-4.8 


Saapla B1xe 


893 


338 




320 


336 




Percent Mho Morel" 






October 1882 « 


> Auguet 1983 






Not Eaployed 1n 0 ertere 
2 and 8 


48.0 


52.9 


.6.8*** 


48.8 


is. r 


-6.0*** 




18.6 


18.5 


+ 0.0 


15.8 


16.6 


-2.6 


Eaployed 1n Querter 2» but 


18.1 


9.1 


♦3.0** 


15.7 


8.1 


♦6.7***yy 


Eaployed 1n Both Quortere 
8 and 6 


83.6 


18*8 


♦3.8** 


21.5 


19.6 


♦ 1 .8yyy. 


Seattle Btn 


1608 


873 




656 


873 
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Tibia C ( 6 (cont 1 nuad J 



BOUfiCEl MDRC eoleulatlona from Unaaployaont Inauranoa atrnlnga raoorda froa the EPP Information 
Syataa. 

N0TE8I Tha data ara ra Q.aaal o n-adj uatad using ordinary laaat aquarao, controlling for 
pro~appl 1oa t1 on oharaotarl at1 oa of aaapla uibin, Thara say ba aoaa df aerapand aa 1n calculating 
auaa and dlffaranoaa dua to rounding. 

Xapaota through quartar 6 vara ragraaal on-aoj uatad »1th a aodal that poolad aarly and 
lata applicant aaaplaat ooafflclanta of oontrol vorlablaa ara oonatralnad to aquallty acr'oaa 
application parloda. 

"Quartar 1, tha quartar of application, say contain aoaa aarnlnga froa tha parlod prior 
to application and la not oonaldarad a trua folloa-up qucrtar. 

A tso-tallad t-taat ■•■ appllad to dlffaranoaa batftaan axparlaantal and oontrol proupa. 
8tat1at1oal algnlfloanoa lavala ara Indloatad aat * ■ 1 0 paroant| « 5 paroant| » 1 percent. 

A tao-tallad t-taat ■■■ appllad to dlffaranoaa In lapaota oataaan application parloda. 
8tat1at1oal algnlfloanoa lavala ara Indloatad aal y * 10 paroant| yy > B paroant| yyy » 1 parcant. 
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TABLE C.10 



BAN DIE90 



AFDC APPLICANTBl IMPACTS OF JOB 8EARCH-EWEP AMD JOB BEARCH 
ON UNEMPLOYMENT INSURANCE BENEFITS RECEIPT, BY APPLICATION PERIOD 
(OCTOBER 188B - AUGUST 1963 IMPACT SAMPLE) 





Job 


8aarch - 


EWEP 


Job Boarch 


Outooaa and Follo*-Up Period 


Exporlaantal 


Co nt poL 


01 f f aranoo 


Exp a r laant a I 


Co ntrol 


Dlf f aranca 








Ootobor 19BB - 


- March 1983 






Evar Received UI Benef Ite, 
















BB.3 


B9.4 


- 0.1 


B8.4 


B9.4' 


- 1.0 


Ever Received UI Benef Ite, 














Quartan 1 - B [%) 


81.7 


81.1 


♦ O.B 


30.1 


31 .1 


- 1.0 


Evar Raoatvad UI Benef Ite, IX) 














Quartar of Application 


BE. 6 


B3.7 


- 1.1 


81 .4 


B3.7 


- B.3 


Quartar B 


1 B.O 


18 .3 


- O.B 


15.3 


18.3 


- 1.0 


Quartar 8 


1B.1 


1B.7 


- O.B 


11 .7 


1 E.7 


- 1 .0 


Quartar 4 


8.9 


9.B 


- 0.3 


10.8 


B.B 


♦ 1.4 


Quartar 5 


8.8 


5.8 


♦ 1 .0 


8.0 


5.6 


♦ B.1 


Quartar 6 


6.3 


8.1 


- 0.8 


6.0 


8.1 


- 0.1 


Quartar 7 


8.6 


5.5 


♦ 1.0 


: 8.8 


5.5 


♦ 1 .1 


Quartar 8 


8.6 


6.9 


♦ 0.5 


7.3 


5.9 


♦ 1.4 


AvaraQa Total UI BeneMte, 
















6BB.0B 


637.95 


- 9.83 


801 .8B 


537.95 


♦13.88 


Avaraga Total UI Beneflte, 
















611.17 


613.39 


- B.BB 


651 .B9 


613.39 


♦37.80 


Avaraga Total UI BanaMta (!) 
















158. B7 


178.15 


-18. BB 


156.75 


178.15 


- B1 .40 


Quartar B 


141.58 


153.96 


-1E.40 


136.86 


153.96 


- 1B.11 


Quartar 3 


97 .08 


65 .95 


+11.11 


95.00 


86.95 


♦ 9.05 


Quartar 4 


68.89 


5B.88 


+ 4.01 


8 '.14 


6B.68 


♦ i4.ee 


Quartar 5 


37.61 


SB. 38 


* e.ts 


6-! .50 


SB. 38 


♦ 19. 1B* 


Quartar 8 


35.73 


34.6B 


* i .1 b 


45.66 


34. BB 


♦ 10.95 


Quartar 7 


85.83 


3E.E4 


♦ 3.68 


44.84 


3B.B4 


♦ 1B.30 




46.01 


SB. 07 


♦ 8.94 


68.11 


39.07 


♦ 17.04 


8aapLa Blza 


87 8 


535 




636 


635 










Apr 1 L - 


Auguat 1983 






« Received UI Banaf Ite, 














u ..•ytcra 1 - 8 (X) 


BB.9 


E3.8 


-0.6 


B8.6 


B3 .5 


♦ 3.0 


Evar Received UI Banaflta (X) 














Quartar of Application 


17.4 


• 1B.3 


♦1 .1 


BO.B 


18.3 


♦ 4.oy 


Quartar B 


11.0 


11.8 


-0.8 


14.0 


11.8 


♦ B.B 


Quartar 3 


7.0 


8.4 


-1.4 


9.4 


8.4 


♦ 1.1 


Quartar 4 


5.5 


8.7 


-1.B 


B.B 


8.7 


♦ 1 .5 


Quartar 6 


5.B 


6.9 


-0.1 


5.B 


5.3 


♦ O.J 


Quartar 8 


3.5 


5.1 


-1.8 


6.7 


6.1 


♦ 0.6 


Avaraga Total UI Beneflte, 














Quartara 1 - 6 (!) 


8E6.64 


365.06 


- ee.51 


45B.1B 


856.06 


♦ 87.18 


Avaraga TotaL UI Banaflta, (I) 














Quartar of Application 


114.15 


1E4.09 


- 9.94 


146.08 


1B4.0B 


♦ BO. 99 


Quartar B 


81.00 


90.98 


- B.B9 


1B7.35 


90.96 


♦ 38.38 


Quartar 3 


57.37 


48.60 


♦ 7.97 


76. SB 


49.60 


♦ 95.88 


Quartar 4 


81.90 


B8.04 


♦ 3.88 


38.37 


B8.04 


♦ 8.33 


Quartar 5 


B6.43 


33. 7B 


- 8.B9 


33.00 


33. 7B 


- 0.71 


Quartar 8 


18.70 


B8.73 


- 1B.03 


35.00 


BB.73 


* 6 .87 


Baapla Blza 


6B3 


8SB 




3 BO 


338 





(continued) 
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Tibia C.10 (continued) 



SOURCE I MDR C celouletlone froe Uneaployeent Insurance beneMte recorde fro* the Btete of Cellfornlo. 

NOTES i The firm, aonth of the querter of eppllcetlon 1e the aonth In which on Individual vet idoaly 
•••Igntd. Thooo dote Include zero veluee for eeaple eeebere not receiving UZ beneMte. There deti ir« 
regreeef on-edj ueted uelng ordlnery leeet equeree, controlling for pre-eppl Ice tl on cherecterl et1 c e of senplw 
■ eebere. Prior UZ benefit receipt «n ^t Included ee e regreeelon oontrol. There eey be eoee tH Bcr»panc1ws In 
celuoletlng euwe end dlfferencee due 'Its rounding. 

Only 1B aonthe of follow-up 1e evelleble for leter epplloente. 

A two-telled t-teet ■■■ epplled to dlfferencee between wxperlwentel end oontrol groupo. 
Btetletloel elgnlflcenoe levele ere Indlceted eel • ■ 10 percentf •• ■ 5 percent! ••• ■ 1 percent, 

A two-telled t-teet wee epplled to dlfferenoee In lepecte between eppiicetlon perlodo. 
8tet1et1cel elgnlflcence levele ere ind'oeted sal y ■ 10 percentj yy ■ 5 percent| yyy ■ 1 percent. 
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TAB Li" C.11 



BAH OIEOO 



AFDC APPLICANTS I IMPACTS OF JOB 8EARCH-£WEP AND. JOB SEARCH, 
BY PRIOR YEAR EMPLOYMENT ANO APPLICATION PERIOD 
(OCTOBER 1882 - AUGUST 1 8B3 IMPACT 8AM r E ) 





Prior 
Eapl oy- 
aant 


1 

Job Saarch - EWEP 


l 

Job Sraroh 


Outcoftk nnd Follow-Up Parlod 


Octobar 1882 - 
March 1883 


April- 
Auguat 1883 


October 1882 - 
Maroh 1883 


I 

Aprll- 
Auguat 1863 


Ev*r Eaployad, Quartara 
2-6 (%)* 


Nona 


♦12. 1*** 
♦ 1 .3 


♦ 6.4yy 

♦ 1.2 


♦ 10. 7" 

♦ 1.8 


♦ 1.8 
4 4.3 


Avaraga Nuabar of duartaro 
With Eaployaant, Cuartara 

2 - 8* 


Nona 
Bona 


♦ G.50*** 

♦ 0.18 


♦ 0.38** 

♦ 0.07 


♦ 0.44*** 

♦ 0.12 


♦ 0.07 
- 0.23 


Evar Eaployad In 
Quartar 6 (%) 


Nona 
Soao 


♦ 6.8* 

- 0.2 


♦ 5.8 

♦ 3.0 


♦ 7.7* 
- 1.8 


- 6.3y 
6.6 


Avaraga Total Earnlnga, 
Quartara 2-6 ($)* 


Nona 
Soao 


♦1222. 1B*** 
♦ 254.51 


+ 85B.63*y 
+438.38 


♦1228.12*** 
♦ 368.16 


- 200.23 
-1058.63* 


Avaraga Tctal Earnlnga, 
In Quartar 6 (I) 


Nona 
Boao 


♦ 258. 64** 

♦ 10.14 


♦216. 16* 
♦166.71 


♦ 245. 83** 

♦ 35.84 


- 141.24 

- 217.54 


Avaraga Nuabar or Month. 
Racelvlng AFOC Payaanta, 
Quartara 1-6 


Nona 
Boao 


- 0.36 

- 0.57 


- 0.40 

- 0.44 


- 0.26 

- 0.52 


- 0.37 

- 0.03 


Evar Racalvad AFOC Payaanta 
In Quartar 6 (X) 


Nona 
Bobo 


- 4.4 
♦ 3.4 


- 1.6 

- 1.7 


- 3.2 
♦ 2.7 


- 1.6 
♦ 2.6 


Avaraga Total AFOC Payaanta 
Pxcalvod, Quartara 1 - B (I) 


Nona 
Soaa 


-238.26 
-313.83 


-247.51 
-265.87 


-151.83 
-253.65 


-161.67 
-273.58 


Avaraga AFOC Payaanta 
Racalvad In Quarter 6 ($) 


Nona 
Soaa 


- 68.03 
♦ 24.81 


- 20.41 

- 11.14 


- 42.67 
♦ 32.17 


- 4.81 
♦ 36.54 


Saaplo Slza 

Hava No Prior Eaployaont 
Hava Soao Prior Eaployaont 


387 
482 


326 | 

I 


252 
264 


58 



( con tl r.ued ) 
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Toble C.11 (continued! 



BOURCEi NORC celculotlone froa County of Bin Ologo xilfi'r ■ ordi end Uneaployaent Ineuranci ricordi froa thi EPP 
Inforiitlbn Syitaa. 

MOTES i Than dote Inoludi lero voluoe for ■•■ pi • aeaban not eaployed and for napl» aeabero not receiving aalfin. *nn 
«ata ara regreeel on-edj ueted uilng ordinary Laait aquiraa, controlling for pro-application charactarl it I ca of eoaple nibari. «r« 
■ ay bo lout dl aoraf and ai In oal oul. 1 11 ng turns and d1fforer.ee dua to rounding. 

Only 18 aonthi of follo*-up la ivallabli for latar applicant!. 

*Quartar 1| tha quartar of application, aoy contain oona nrnlnga froa tha ported pl r r to application ind la 
therefore included froa tha natural of total folloa-up enployaint ind larnlnga. 

b 

The flgurn pranntad in tha enparlaantel-control dlffarincei end thalr ititlatlcol elgnlf Icence. 
C?afflclanta of ragraailon control virloblia an conatralnad to equality acron rainrch groupi and acroai 

tubgr oupe a 

A uo-tallid t M ta at aai ippUad to dlfferancaa batiain axpariaantel and control groupa. Stitlatlcel elgnlflcenc* 
lavile an Indicated eel • ■ 10 percent} ** « 5 percent) ••• c 1 percent. 

A tat-toHad t-taat vae epplled to dlfferancaa In lapecte batman eppUcatlon parlode. Statletlcel elgnlficance 
levoli if' I cat ad aei y c 10 percent) yy » 5 paroant) yyy « 1 percent. 
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TABLE C.12 



8AN DIEGO 

AFOC APPLICANTS! IMPACTS OF J 09 SEAR CH-EWEP ANO J 09 SEARCH ON KEASUREO INCOME, 9Y APPLICATION PERIOO 

(OCTOBER 1982 - AUGUST 1983 IMPACT SAMPLE) 





Oct obo r 


1682 - March 


1863 


I 

Apr 1 1 - Auguat 


1863 


Qutcoaeond Follow-Up Quit tar 


E xpe r 1 aente I 


Cont rol 


0 1 rraranca 


Exparlaantal 


Co n t f n L 


0 1 rraranca 








Job Seerch-EWEP 






Averege Total Zncoae Received, 














Quartara C - 8 [•)' 


B7S6.02 


8329.70 


+4S8 .3 2 9 


7 21 5 .68 


8 898 .0 4 


4316.64 


Averege Total Insoee Received, 














Quartara 2-8 (I)" 


8509.07 


87 23 .88 


♦786. 21** 


n/i« 


n/a 


n/a 


Averege Total Zncoae Raca1vad(l] 














Quartar of Application 


a 


a 


a 


a 


a 


a 


Quortar 2 


1348.07 


12B4.82 


♦ 83.25 


14B8.25 


1 411 .20 


♦76.05 


Quartar 8 


1 307 .37 


1 265.69 


♦101 .48 


1 464.9 4 


1402.45 


♦ 6 2.49 


Quartar 4 


1378.55 


1284. R3 


♦ 61 .72 


1434.83 


1426.60 


♦ 6.03 


Quartar 5 


i3BB.ee 


1251 .90 


♦ 118. SB 


1347.14 


1345.43 


♦ 1 .71 


A ii a n t « n O 


1 J J / t> / O 


4 Ot <~ 07 


♦1 05.48 


1 479.92 


1313.35 


♦ " Bo iB H 


Quartar 7 


1042. B4 


; 4 


+148.70* 


n/a 


n/a 


n/a 


Quartar B 


1353.11 


•» . :2 


♦ 121 .90 


./a 


n/a 


n/a 


b 

Statua During Quartar B (X) 


• 












U m Pll 1 p na ICtl ^ Dauainf 

no iirni r yi| Aru riy isni ■ 














or Ul Benef 1 ta 


30.3 


34.8 


-4.3 


31.9 


30.6 


♦ 1 .1 


No aarnlnga, and aoao AFOC 














Poyaento or UI BeneMte 


29. B 


28.8 


-0.1 


23.1 


27.6 


-4.7 


8oao aarnlnga, AFOC 














Payaanta or UI BuneMte 


12.1 


13.1 


-1 .0 


12.0 


1 1 .8 


♦ 0.2 


8oao aarnlnga, no AFOC 














Poyaanta or UI BanaMts 


27.9 


22.4 


♦5.5 


32.9 


29.8 


«3.3 


8aapla S1za 


67 9 


535 




823 


338 





Avaraga Total Zncoaa Received, 
Quartara 2-9 ($)* 

Avaraga Total Zncoae Received, 
Quartara 2-8 (I)* 

Avaraga Total ilncoaa Recelved(l) 
Quartar or Application 
Quartar 2 
Quartar 3 
Quartar 4 
Quarter 5 
Quarter 8 
Quartar 7 
Quartar 8 



Job Search 



7006.^1 



97B1 .33 



1411 .63 
1450.15 
1387.1 6 
1356.72 
1380.45 
1362.81 
1365.91 



6328, TO 



6723.68 



1284. B2 
1 285.88 
1284.83 
1251.90 
1282.27 
1184.14 
1231 .22 



♦ 876. 40** 



♦1037.47** 



158. 61*** 
184. 26*** 

72.33 
104.62 
1B6<18* 
186. 77** 
134.70 



6082.66 



n/a 



1380.54 
1258.17 
1148.44 
1144.83 
1150.08 
n/a 
n/a 



8899.04 



n/a 



1411 .20 
1402.45 
1426.60 
1345.43 
1313.35 
n/a 
n/a 



-806.19**yyy 



n/a 



- 20.66y 

-144,2Byv* 

-277.1«***yyy 

-200.60**yy 

-183.28yy 

n/a 

n/a 



8tatua During Quartar B (X) 

No aarnlnga, AFOC Payaanta 
or UZ Banar 1ta 

No aarnlnga, and aoao AFOC 
Payaanta or UZ BeneMte 

8oaa aarnlnga, AFOC 
Payaanta or UZ Benefits 

8oaa aarnlnga, no AFOC 
Payaanta or UZ Benefite 




35.8 



30.0 



11.3 



22.8 



30.8 



27.8 



11 .8 



29.6 



♦ 5.1 



♦ 2.i 



-0.5 



-6. 8 



Seeple Size 



536 



535 



320 



ERLC 



-210- 277 



338 



Tabla C. 1 2 (continued) 



SOURCE I NDRC oelculetlona f roa County of Sen Diego eelfere rocordo end Unemployment Znouronco eernlnge reoorde 
froa the EPP Znforaetlon SYetea and Unoaployaont Znouronoo beneflte rocordo froa the State of California. 

HOTESl Nooourod Incoao la daMnad aa total urntngi, eelfere peyaente, and Unaaployaont Coapeneetlon received 
during o oolondor quartar. 

Thaaa data Include zero valuaa for ooaplo aoaboro not oaployod and for ooaplo aaabara not receiving 
aalfara or UZ beneflte. Thaaa data ara regreeal on-edj uatad uafng ordinary laaat equeree, controlling for 
pre-eppl lea tlon charge tar t at 1 ca of ooaplo aoaboro. There aay ba mourn dl acrepenc 1 ee In calculating auaa and 
dlffarenoee dua to ror.iding. 

"Maeeurftd Znooae 1e not evelleble for tho quortor of oppllootlon bocouoo only Indlvlduele vho oppllod 
for AFDC during tho flret aonth cf tha oolondor quartar have Information about aelfere poyaonto for tho full three 
aontho of that year. 

b 

Tha oalouletlone for Znooao Stetue during Quortor 6 neve not boon regreeel on-edj ueted | teete of 
etetletloel olgnlfloonoo neve not boon oppllod. 

A tao-telled t-teet wee oppllod to dlfferencee between oxporlaontol end control groupe. Btotlotlcol 
olgnlfloonoo lavala ara Indicated aal • ■ 10 parcantl ■ 8 paroontl ■ 1 percent. 



A tao-telled t-teet aee applied to dlfforonooo In lapacta bataaan application perlode. Stattettcel 
elgnlMoence lavala ara Indlootod aal y ■ 10 parcantl yy ■ 8 paroontl yyy * 1 percent. 



TA8LE C.13 



SAN OIEGO 



AFOC APPLICANTS: SELECTEO IMPACTS OF J08 SEARCH-EWEP 
AND JOB SEARCH, 8Y PRIOR AFOC RECEIPT HISTORY 
(0CT08ER 1982 - AUGUST 1983 IMPACT SAMPLE] 





Prior 




Job Sae.*ch 


- E*EP 


Outcome find FollON-lip Period 


ACnr 

t% r U U 

History 


Experimental Control 


01 f f erence 


Ever Employed, 
Quarters 2-6 [%) 


No Prior AFOC 
Two Years or Less 
More Then Two Years 


62.8 

c n o 

59.3 


62.9 
52.0 


-0.1 

, n a ft ft ft I. 

+ 9 .1 "*y y 
+ 7. 3" 


Averoge Number of Qua r t e r b^W 1 t h 
Employment? Quarters 2 — B 


No Prior AFOC 

i no Tears or uboo 

Mo re Than Tn*c Years 


2.15 
2.01 
1 .92 


1 .98 
1.60 
1 .64 


+ 0.16 
+0 .41 *** 
+0.28* 


Ever Employed 1n 
Quarter 6 (2} 


No Prior AFOC 
Tno Years or Less 
More Then Tno Years 


45 .5 
40.1 


43.8 
?5 . 0 
3 5.7 


+ 1.7 
+ 4.4 


Averegs Total Earnings, 
0} 

OimrtnrR 2 — 6 ftl 


No Prior AFOC 
Tno Years or Less 
More Than Tno Years 


4399.39 
3 1: 0 9 • 4 5 
3uo*2<04 


4002.93 

*a o ^ i a o 
d a / 4 • 9 b 

2372.49 


+396.46 
+o34.4B*** 
+709 SB* 


Average Total Earnings in 
Quarter 6 [$} 


No Prior AFOC 
Two Yea r 8 or Less 
More Than Tno Years 


1129.12 

Q A C QC 
910.90 

722.96 


1044.96 
557.92 


+ 84.16 
+165.04 


Average Number of Months Receiving 

iCHr Douirflnt 1 c Dim pto pb 1 «~ 6 
ArUu ra y Bion * o i*uari»oro i w 


No Prior AFOC 

Tin Yiifl ps fir (are 

1 H U I O G 1 O Ul *m C D D 

More Than Tno Yaars 


6.24 
8.57 
9.78 


6.S2 
9.12 
9.93 


-0.68 
-0.56 

-fi 3 14 


Evar Received Any AFOC Payments in 
Quarter 6 1%} 


No Prior AFOC 
Tno Years or Less 
More Than Tno Years 


24.4 

Q7 A 

44.6 


26 .3 

TP 7 

44.5 


-1.9 

1.0 

+ 0.1 


Average Total AFOC Payments 
HGC6 1 v cQf uud ne rs i q i»j 


No Pr1o- ~<=CC 

T m n V a a p c n i* Lpcd 

IHU ,1 GO TO Ul InCDO 

Mora Than Tno Years 


26C7.22 
3542.31 
4178.91 


2873.31 
3908.28 
4379.64 


-266 .09 

-365.96* 

-200.74 


Average AFOC Payments Received in 
Quarter 6 [$} 


No Prior AFOC 
Tno Years or Less 
More Than Tno Years 


302.80 
418.74 
571.28 


304.57 
497.41 
539.00 


- 1 .77 

-78.67* 

+32.28 


Sample Size 


No Prior AFOC 
Tno Years or Less 
More Than Tno Years 


515 
575 
412 


274 
348 
25T 





[continued] 
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TABLE C.13 (continued] 





Pri or 
AFOC 
HI story 


4ob Search 


Outcome end FoL Low-Up Period 


Experlmentel Control 


01 f f erence 


Ever Employed, 
Quarters 2- 6 i X J 


No Prior AFOC 
Two Yeare or Less 
More Than Two Years 


62.8 
63.3 
53.6 


62.8 
51 .6 
52.0 


- 0-0 

+ 11.7***yif 
+ 1.6 


Average Number of Quarters With 
Employment, Quarters 2-6 


No Prior AFOC 
Two Years or tese 
More Then Two Yeere 


1 .88 
1 .88 
1.60 


1 .88 
1 .60 
1 .64 


+0.00 

+0.38***y 

-0.04 


Ever Employed In 
Quarter 6 (%] 


No Prior AFOC 
Two Yeare or tees 
More Than Two Veers 


38.8 
40.4 
31 .7 


43.8 
35.0 
35.7 


-5.0y 

♦5.3 

-4.0 


Average Total Earnings, 
Quarters 2-8 1$) 


No Prior AFOC 
Two Yeara or tees 
More Than Two Yeere 


3744.01 
3411 .75 
2806.85 


4002.83 
2874.88 
2372.48 


-258.92 
-1-536.78 
+434.37 


Averege Tc , H Eernlngs In 
Quarter 6 i$) 


No Prior AFOC 
Two Yeere or tees 
More T hen Two Yeere 


887.08 
781 .87 
692.13 


1044.86 
700.47 
557.82 


-147 ,88 
+ 81.40 
v134.21 


Averege Number of Months Receiving 
AFOC Payment*, Quarters 1-8 


No Prior AFOC 
Two Years or tees 
More Then Two Years 


6.41 
8.86 
8.83 


6.82 
8.13 
8.83 


-0.51 
-0.28 
-0.04 


Mved Any AFOC Payments In 

f w \ 

I*; 


No Prior AFOC 
Two Yeara or Lees 
More Than Two Yeere 


24.4 
38.7 
45.4 


26.3 
38.7 
44.5 


-1 .8 
+1 .0 
+0.9 


*ge Total AFOC Payments 
Racelvedt Quarters 1-6 ($] 


No Prior AFC'C 
Two Yeara or teee 
Mors Then Two Years 


27 42.67 
3881 .13 
4127.75 


2873.31 
3808.28 
4378.64 


-130.64 
-227.15 
-251 .88 


Averege AFOC Peymente Received In 
Querter 6 ($] 


No Prjor AFOC 
Two Years or tees 
More Then Two Yeere 


324.18 
486.31 
538.55 


304.57 
487.41 
538.00 


+18.62 
•11.10 
- 0.45 


Sample Size 


No Prior AFOC 
Two Yeare or tee- 
More Then Two Yeere 


285 
330 
241 


i7 4 
346 
£51 





SOURCE AND NOTES t See Table 3.2. 

Coefficients of regression control verlables ere constrained to 
equellty across reseerch groups and aorose aubgroupe. 

A two-tailed t-test wes epplled to differences between subgioupe. 
Stet1et1cew significance levele ere Indlcetad ee followei y = 10 percent; yy = 5 percent, 
yyy s 1 percent for the differences between thoee with no prior AFOC history and those mi'n m 
receipt history of two yeere or less; end x = 10 percent; xx = 5 percent; *xr, = 1 percent 
for the dlfferencee between thoee with no prior AFOC history end thoee with e receipt history 
q lore then two yeere. . 
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TABLE C.14 



: SAN 0IE90 

AFPC APPL ICAHT8 • SELECTED IMPACTS OF JOB SEAR CH-EWEP 
AND JOEf SEARCH, BY NUMBER OF CHILDREN 
(OCTOBER 1882 - AUGUST 1983 IMPACT SAMPLE ) 





Nuaber 


1 

Job 


Seerch - 


EWEP 


M0b Search 


Out^ONO and Follow-Up Period 


of 

Children 


E x p b r < -ia n t l L 


Control 


Difference 


?xpe r 1 aant a I 


I ' o r t f o I 


01 ffarence 


Evar Employed, 


One 


82.8 


67 .1 


♦6.B»» 


B4.0 


57.1 


♦6.8 ## 


t 

Quartere 2 - B [%) 


More then One 


68.1 


63 .7 


♦5.6** 


6B .8 


63.7 


♦3.2 


Average Nuaber of Quertere With 


0 i 


2.05 


1 .62 


♦0.23** 


2.00 


1 .82 


♦ 0.17 


Eaployaent, Ouertere 2-8 


More than Ona 


2.00 


1 .B6 


♦0.36*** 


1 .76 


1 .66 


♦ 0.11 


Ever Eaployed In 


One 


41 .B 


40.7 


♦1 .1 


3B.4 


40.7 


-2.3 


Ouarter B [%) 


More then Ona 


42.1 


36. B 


♦B.4*» 


3B.4 


36.0 


♦0.7 


Average Total Eernlnga, 


Ona 


3B70.BB 


3334.1 I 


♦536. 48* 


3612.45 


3334.18 


♦17B.27 


Quertere 2 - B (•) 


Mora than Ona 


3734.04 


2BB3.43 


+860.B1*** 


3180. 16 


2863.43 


♦300.89 


Average Totei Eernlnga In 


Ona 


921 .40 


BB9.72 


♦ 51 .3By 


842.47 


889.72 


-27.26 


Quarter B (•) 


Mora than Ona 


946. B2 


BB4.1B 


♦ BB1 ,40*** 


763.36 


804. 1B 


♦89.19 


Averege Nuaber of Month*. Receiving 


Ona 


7 .BQ 


7.83 


-0.83 


7 .77 


7.83 


- 0.05 


Ar"?C Peyaente, Quertere 1-8 


Mora than Ona 


B.BB 


8.37 


-0.71» 


8.88 


8.37 


- 0.49 


Ever Received Any AFOC Pey».nta In 


Dna 


31.9 


30.8 


♦0.4 


32.2 


30.9 


♦ 1 .3 


Querter B (X) 


More then Ona 


3B.B 


41 .2 


-B.B 


40 .2 


41 .2 


-1.0 


Av lt b tj a T otel AFOC Peyaente 


Ona 


2801 .61 


28BB.2B 


-1BB.76 


8818.82 


268B.8B 


- 61 .34 


Race ved, Quartare 1-8 (•] 


More then tne 


4011 .03 


4406.81 


-386 . 87** 


408B.89 


44QB.B1 


-340.02* 


Averege AFOC Peyaente Received In 


On* 


330. B4 


333 .68 


- 2.74 


343.77 


333.68 


♦ 10.19 


Quarter 6 (•) 


Mora than Ona 


514.00 


654.00 


-38.89 


650.11 


5B4.0Q 


- 3.88 


Beaple Size 


Ona Child 


756 


419 




43 3 


418 






Mora than 














Mora Than Ona Child 


747 


454 




423 


464 





SOURCE AND NOTESl Sea Tabla 3.2. 



Coefflclente of rat ' ■ - ntrol verleblee era conatralned to equality acroaa roeaerch groupo end 

acroae eubgroupe. 

The More Then One Child ctlMgory contelne a aaell nuaber of Indlvlduele «Hh zero for nuaber of 

chl I dr an. 

None of the dlfferencee In lepecte beteeen eubgroupe ere ete 1 1 e 1 1 ce 1 1 y algnlflcent et the 10 percen 
level uelng e tajo-talled t-taet. 
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TABLE C.15 



SAN OIEQO 

AFDC APPLICANTS! WELFARE RECIDIVISM, BY 
RESEARCH GROUP AND APPLICATION PERIOD 
(OCTOBER 1962 - AUGUST 1983 IrFACT SAMPLE) 





October 1988 - March 


1983 


April 


- August 1983 


October 1982 - August 1983 


Ivlm Status 


Job 9earch- 
EWEP 


Job 
Search 


Control 


Job Search- 
EWEP 


Job 
Search 


Control 


Job Search- 
EWEP 


Job 
Search 


Control 


a 

re Reoldlvlow [%) 


13.9 


11.0 


11.2 


11.9 


16.3 


12.4 


13.0 


13.0 


11.7 


n the Blx Quarter 
v-Up Period! 1%) 




















(el fare, Goee Off and 
sr Returns 


43.3 


44.B 


44.5 


48.9 


45.0 


42.9 


44.6 


44.9 


43.9 


ays on Welfare 


26.3 


89.1 


30.1 


25.0 


24.4 


27.0 


25.8 


27.3 


29.2 


sr on Wei fere 


18.5 


15.1 


14.2 


18.2 


14.4 


16.9 


1B.4 


14.8 


15.2 


b 91za 


879 


536 


535 


923 


320 


338 


1502 


858 


873 



SOURCE! MORC calculations fro* County of Sen Olegu pel fere records free) the EPP Information Syetea. 

°An Individual la conriderad a welfare reoldlvlet If he/she 1e on welfare, goee off welfare, end then returns to welfare 
lee within six quarters of follow-up. The quarterly welfare Infcrietlon, however, does not pick up eonthiy eoveesnt on end off 
ills. 

These figures were not regreaeloft-odjueted. 

Olfforencee eeong rsseerch groupe were not found to be statistically significant at the 10 percent Level uelnp e 
luare teat. 

283 

Tilt, of atatlatlcal ilgnirioanM bataaan application parloda aara not ealoulatad. 
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TABLE C.16 



SAN 0IE60 

AFOC APPLICANTS : ESTIMATED REGRESSION COEFFICIENTS FOR TWELVE- MONTH FOLLOW-UP, 

SELECTED EMPLOYMENT ANO WELFARE MEASURES 
(OCTOBER 1888 - AUGUST 1983 IMPACT SAMPLE) 



Variable 


1 

Ever EatoLovad 

■w v v i as hi a# aj ae j ea aa 

In Quarter 6 


1 

Kw 1 II 1 II |4. Ill 

Quarter 6 


AFOC Race lot 

fy i w m n d m o i pt 

In Querter 6 


r 

Total AFOH 
Pa v Bint i In 
Quarter 6 


.1 ft •') r i <v * v c h — E£ E P 


+ 3 8 a 
(2.0) 


+ 1 B n r a » a * 
(58.08) 


- 1-2 

1 . m 

(2.0) 


— QQQQ 

C* C • W M 

[27.12] 


Job Search 

W M M W M 11 1 Mil 


-0-7 

War 

(2.3) 


+ 26.26 
(66.66) 


+ 0.0 

(2.2) 


+ 1.72 
[30.60] 


a 

Sun Oinnn Wait 


















Ocean a1 da 


+0.3 
I 3-4 1 


, + 41 .12 
( 100.56 ) 


- 7.5** 
[3.4) 


- 82.76** 
[ 46 - 1 6 1 


San 01 c^o East 


+4.8 

1 o • • J 


+197.74** 
(93 .1 8 ] 

I w w a) i v j 


- 5.2* 
[3.1 ) 

1 W . 1 j 


- 77.83* 
[ 42 .76 ) 


Service Center 


+3.7 


+100.75 
r op 1 1 1 

1 DC . 1 1 J 


+ 0.3 

[2-7 1 


- 12.60 
f 37 - 69 1 


EaconcM do 


+6.8** 

[3.5 ] 


+184,60* 
(102.17) 

1 IUK 1 1/ J 


- 3.3 
[3.4 ] 


- 89.19* 
( 46 .89 ] 


South 8 a v 

W M U V 1 1 MOT 


+4.5 
[3.1 ) 


+ 62.27 
[90.80 : 


+ 2.3 
[3.0) 


+ 8.90 
[41 .67) 


E L Ca i on 


+5.5** 

(2.7; 


+ 47.12 
[81 .00 J 


2.9 
(2.7) 


- 42.53 
[37.18] 


Age 24 Years or 
L o a a 


+1 .6 

[ 3.0 ) 


-110.38 
f 87 -55 1 

| M r . M M> J 


6 t f; t lt 
[pa. 


+ 90.25** 
[ 40 • 1 8 J 


Age 25-34 Years 8 


















Age 35-44 ^eers 


+ 2.3 
(2.0) 


+ 36.28 
(58.17) 


- 3.2* 

11. B] 


- 58.32** 
[26.70] 


Age 45 Years or 
More 


-1 .2 
(3.1 ) 


- 63.54 
(91 .94) 


+ 3.4 
[3.1 ) 


- 13.82 
[42.20) 


Feme L e 


+ i «6 
(2.6) 


-166.15** 

(76.ir ; 


+ 1 .7 
[2.5] 


- 17.05 
(34.93 ) 



l contl nued ) 
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TABLE C.16 (continued] 



Variable 


1 

Ever Employed 
In Querter 6 


I 

Earnings In j 
Querter 6 


- 


eel pt 
rte* 6 


Totel AFOC 
Pay man* a In 
Quarter 6 


White. Non- 
a 












HI epanl c 












B L a c k . Non~* 
HI epanl c 


-0.7 
12.4) 


- 61 .B9 
(71. B1 ) 


+ 


10.0*** 

(2.4) 


+147. 73*** 
[32.96] 


HI epanl c 


-0.6 
(2.5) 


- B1.24 
(74.21) 


+ 


5.3** 

(2.5) 


* 92. 09*** 
(34.06] 


Other Ethnic 
Groups 


-0.7 
(4.2) 


-116.04 
(125.29) 


- 


1.6 
(4.2) 


+ 4.99 
[57.51 ] 


High School 
Diploma or 
General Equival- 
ency Dip Lome 


+9.0"* 
d.B] 


+27B.63*** 
(52.96) 




6.4*** 

(1.B) 


- BB.9B*** 

(24.31 ) 


Nov e r Me r r 1 ed 


-1.7 
(3.5) 


- 79.41 
(102.66) 


+ 


11. 0*** 

(3.4) 


+107.76** 
(47.12) 


Harried, Living 












With Spouse 












Married, Not Liv- 
ing With Spouse 


+0.2 
(2.9) 


-107. 4C 
(B7.19) 


+ 


7.0** 
(2.9) 


+ 7B.B1** 

(40.02) 


Divorced or 
W1 dowed 


+0.2 
[2.9) 


- 94.46 
(BB.53) 


+ 


*.7 
(2.9) 


+ 42.45 

(39,72] 


Number of Child- 
ren Less Then 

1 Q Yr ipb Old 


-0.3 
(0.9 ) 


+ 2.31 
(25.55) 


+ 


4.1*** 

(0.9) 


+112. 9B*** 
(11.73) 


Any Children Less 
Thon 6 Yeere Old 

e 


-3.3 
(2.5) 


- 19.90 
(73.16) 


+ 


6.7*** 

(2.4) 


+ 47. B2 
[83. SB) 


Never on AFOC 












On AFDC Two 
Yeere or Less 


-3.5* 
(2.0) 


-126. BB** 
(59.72) 


+ 


11.1*** 

(2.0) 


+123.64*** 

(27.41 J 


On AFDC More 
Then Two Yeere 


-5.1** 

(2.2) 


-263.57*** 
(66.45) 


+ 


17. 6*** 

(2.2) 


+213.61*** 
(30.50) 


Held e Job During 
Four Quarters 
Prior to 
Appl 1 ce 1 1 on 


+13.7*** 

(2.0) 


+109.53* 
(60.22) 




3.0 
(2.0) 


- BB.94*** 
(27.64) 



(conti nued) 
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TABLE C16 (continued) 



Variable 


Ever Employed 
In Querter 8 


Earnings In 
Quarter 6 


AFOC Recel pt 
1 n Que rter 6 


Totel AFDC 
Peynente in 
Querter 6 


Total Earnlnga 
Ou r 1 ng -Four 
Quartara Prior to 
Application (In 
Thouaanda of 
Ool lara] 


+1 .8*** 

[0.2] 


+ 84.23*** 
(8.81 ] 


- 0.8*" 
(0.2] 


(3.17] 


Conat a n t 


(4.3J 


TO 1 II . Q 1 

(126.87] 


+ 17-2*** 
(4.2] 


+207.86*** 
[58.14] 


Number of 
Obaarvatl ona 


3231 


3231 


2231 


3231 


R Square 


.0980 


.1310 


.0807 


.1027 


Dependent Verle- 
ble Average 


39.7 


854.38 


35. 6 


435.34 



SOURCEt MORC calculatlc from County of Sen Diego welfere records end 
Unemployment Insursnce earning* tecorda from the EPP Informetlon System. 

NOTESx Sample elzee for the AFDC groupe ere ee folloeei 1502 Job 
Search-EWEP Experimented; 856 Job Search Expe r i mentel a ; and 873 Controls. 

Regressions preerited In this table corroepand to Impect estimates 
presented in tebla 3.2. 

Eetlmeted atandard errore ere In perenthesee. Levels of 
atetlstlcal at gnl f 1 cence x * * 10 percent; ** = 5 percent; *** * 1 percent. 

Thaae dete Include zero veluec for eemple membere not employed end 
for ee membere not receiving welfare. All regreeelon estlmetes ere by 

ordl ne ry leest eque res. 

"tfhera emblgultlea mey arlss, reference groups for categorical 
variables are Indlceted by deshSL In the tebla. 
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TABLE 0.1 



SAN 0IB50 

AFDC-U APPLICANTS t SXX-MQNTH PERFORMANCE INDICATORS, 
BY RESEARCH GROUP ANO APPLICATION PERIOD 
(OCTOBER 188B - AUGUST 1B83 SAMPLE] 



Six-Month Perforaence Indicator 


Job 8eerch-EWB> 


Job Seerch 


uctooer i sac 

U.H.L ton 

narcn i ooo 


Apr 1 l 

AUgUBb 1BB9 


n nfnha ft 1QQ9 
UCbODBr 19QC 

Matrrh 1 fifiS 

narcn 1000 




Pnnf artaH Mai* Ira Pol* .1 oh PI arMant. 










A§a4 atanra I Hi 


B8.5 


80.3 


BB.fi 


88.7 


Referred to a Job 


Q Q 
O .0 


7 0 


A 3 


5.0 


Acoaptad Job Offar 


n n 

U.U 


n n 


n n 

« u 


n n 


negieterea witn err* i*j 




Op A 


RR R 


02.8** 


rOrCl Cl petOu In Any ruB* neyi vbrDbiun 










Activity (X) 


53.1 


50.3 


48.1 


47.7 


Participated 1n Job Search Workshop (X)* 


51.8 


48.5 


47.0 


47.0 


Found EapLoyasnt Ourlny Workehop 


14.4 


15.5 


10.1 


15.0** 


CoapLeted Workshop. Not EapLoyed 


2B.2 


26.1 


2B.B 


23.1* 


Did Not CoapLete Workehop 


8.3 


B.O 


B.1 


8.0 


EWEP (X) 










Referred to EWEP 


26.7 


25.3 


0.0 


0.0 


Interviewed by EWEP Steff 


21.4 


18.1 


0.0 


0.0 


Aeelgned to Worksite 


18.8 


17.5 


0.0 


0.0 


Worked at Least One Hour at Worksite 


TB.5 


t3.4 


0.0 


0.0 


c 

Received Other EPP Services (X) 


2.4 


3.3 


2.4 


4.0 


Oeregletered Froa EPP (X) 


5B.B 


B1.7* 


5B.1 


54.5 


Oue to Requeet for Sanction (X) { 


5.0 


5.2 


3.7 


5.3 


d 

Progress PLeceaent (Found EapLoyaent] (X) 


30.5 


31.8 


28.B 


31.5 


e 

Totel AppMcente 


763 


B40 


534 


321 



SOURCES HDRC ceLcuLetlons froa the EPP Inforaetlon Syetea end EWEP Activity Logo. 

NOTES* ALL perforaence Indicators ere caLcuLated as e porcentege of aLL eppUcante 1n the 
Indicated reeeerch group. 

B Pert1c1pet1on 1e defined ee ettendlng e workshop for at Leeet one day. 

[continued] 
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TABLE 0.1 (continued) 



b Infor«et1on on BfEP activity 1s obtained froa EWEP Activity Logs Maintained by the San 
Oiago County Department of SodeL Servlcea. Aa compared to the other 1nd1cetore 9 BfEP Log dete provides 
alightly Leee poet-eppL1cet1on foLLoe-up for Individuals applying during the letter pert of eny 
partlcuLer aonth. 

C 0ther EPP eervlcee Includee On-the-Job Tre1n1ng 9 eubaldlzed eaployaenti Individual job 
search* end WIN Work Experience. 

d Prograa pleceaent Information 1e beeed on aepLoyeent thet 1e reported to prograe etaff. 
Pro gran pleceaent dete nlLL not be ueed to eeeaure prograe lapacts. 

*Excludae eppUcente elsslng AFDC peyaente for at leeat one annth within the first six 
aontha after appUcetlon. 

Olfferencee betaeen appUcetlon perlode within a research group are statistically 
slgnlflcent using s ch1-aquare test et the following Levelsi • = 10 percent; = 5 percent; 
= 1 par cent. 
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TABLE D.e 



SAN DIBBD 

AR)C-U APPLICANTS! ATTENDANCE AND COMPLETION DATA TOR JOB SEARCH WORKSHOP PARTICIPANTS, 

BY RESEARCH GROUP AND APPLICATION PERIOD 
[OCTOBER 1982 - AUGUST 1863 SAMPLE] 





Job Search- BfEP 


Job Beerch 




f) fit nhs p 4 QOO 

UwbUUVr 1 DOC 


Apr 11- 


October 1882 - 


Aprll- 


Indicator 


Merch 1883 


Auguet 1883 


Merch 1883 


Auguet 1863 


Days Attonoeo [%) 






* 


IB. 4*** 


1 to 5 Days 


17.7 


14.5*** 


17.0 


8 to 1D Days 


80.5 


34.2 


17.3 


32.3 


11 to 15 Daya 


58.7 


50.1 


65.3 


47.5 


18 Daya or More 


2.1 


1.2 


0.4 


1.8 


Avarage Total Daya Attended 


10.5 


10.3 


10.B 


8.B 


Average Total Days Excused Absence 


1.0 


0.8 


1 .0 




Averege Total Deye Unexcueed Abeence 


D.7 


0.4 


0.4 


0.4 


Cutcoae of Job Seerch Workshop 










Purtldpetlon (%) 








31.0 


Found Eeploy«ent During Workehop 


2B.3 


31.8 


20 .8 


Completed Workshop, Not Enployed 


54.1 


52.2 


B2.B 


50.0 


Did Not Complete Workehop, 






B.5 


7.0 


Mey Be Reecheduled 


B.5 


B.B 


Did Not Complete Workehop, 








12.0 


Not Reecheduled 


11.1 


8.1 


10.1 


Totel Nuaber Who Participated 








15B 


et Least One Dey 


434 


338 


277 



SOURCE! MDRC celculetlone frosi the EPP Inforwetlon Syoten'e Job Search Workshop Attendance Logs. 

NOTESi Theee date Include only thoee registrants Mho pertlclpeted In a Job Seerch Workshop for et 
leeet one dey within elx «onthe of eppllcatlon., All Indlcetore are celculeted ee a percentege of ell 
pertlclpente In the Indlceted reeearch group. 

Distributions wey not odd exectly to 100.D percent beceuse of rounding. 

8 Dutco«e of workshop pertlclpetlon Is beeed on raployoent otetue reported to progree eteff 
et the tine an Individual leevee the workshop. 

Dlfferencee between eppllcetlon perlode within e research group are stetlstlcsllv 
significant using a two-tsUed t-test or chl-equere test et the following leveLsi • = 10 parcant| = 5 
percent j = 1 percent. 
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TABLE D.3 



AFOC-U APPLICANTS t IMPACTS OF J 08 6EARCH-EWEP AN 0 JOB 6EARCH 
ON UNEMPLOYMENT INSURANCE BENEFITS i BY APPLICATION PERIOO 
(OCTOBER 1082 - AUGUST 18B3 IMPACT 6AMPLE) 





Job Saarch-EiEP 


Job Baarch 


Outcoaa and Follow-Up Period 


Exparlaantal 


Control 


01 f f aranca 


Exparlaantal 


Control 


01 f f aranca 








Octobor 1882 


- March 1883 






Ever Racalvad UX Biniflti, 












♦ 1.7 


Quartara 1 - B [%) 


63.2 


65.4 


- 2.2 


67.0 


65.4 


Evar Racalvad UI Benefltai 














Quartara 1 - B [%) 


54. B 


66.7 


- 2.1 


68.6 


66.7 


♦ 2.1 


Evar Racalvad UI Bin-fit- it) 










46 .2 


♦ 0.6 


Quartar of Application 


46*0 


48 .2 


l mm 


46 .8 


Quirtir 2 


36.1 


38.8 


- 0.8 


36.4 


36.8 


- 0.5 


Quartar 3 


23.6 


24.8 


- 1.4 


25.8 


24.8 


♦ 0.8 


Quartar 4 


17*4 


1 7 . B 


™ 0.4 


18.8 


17.8 


♦ 1.1 


Quartar 6 


10.8 


14.3 


- 3.3* 


13.8 


14.3 


- 0.3 


Quartar 6 


8.6 


11.3 


- 1.5 


11. B 


11.3 


♦ 0.6 


Quartar 7 


10.2 


11.3 


- 1.1 


10.2 


11.3 


- 1.1 


Quartar B 


8.1 


12.6 


- 3,5 


11.6 


12.8 


- t.1 


Avaraga Total UI Beneflte, 












♦ 66.27 


Quartara 1 - 6 [$} 


1286.61 


1375.15 


- 78.54 


1431.42 


1375.15 


Avaraga Total UI Banaflta* 












♦ 21.68 


Quartara 1 - B 1*3 


1433.83 


1578.78 


- 144.83 


1600.34 


1678.76 


Avaraga Total UI BanaMta It] 














Quartar of Application 


425.61 


442. ?D 


- 18.80 


444.35 


442.20 


♦ 2.14 


Quartar 2 


368.72 


403 .02 


- 33.30 


371.36 


403 .02 


_ 31.66 


D li m f* m f* 9 


230.34 


2i5.81 


♦ 14*42 


261 .36 


215.81 


♦ 35.47 


Quartar 4 


126.65 


141.88 


- 15.24 


148.86 


141.88 


♦ 7.06 


Quartar 6 


71 .03 


1 n n or 


- 28.22* 


116.60 


100.25 


♦ 16.25 


Qua r t a r 6 


73.27 


71.88 


♦ 1 .38 


88.88 


71.88 


♦ 28.01 


Quartar 7 


B5.B8 


83.84 


- 28.06* 


78.20 


83.84 


- 15.74 


Quartar 8 


78.35 


88.03 


- 20.66 


80.88 


88.03 


- 8.14 


6aapla 61za 


741 


488 




613 


488 










April - Auguat 1883 






Evar Racalvad UI BanaMta* 










46.8 


♦ 1.7 


Quartara 1-6 [%) 


47.8 


46.8 


♦ 0.7 


48.6 


Cy a . Racalwad UI Blfllf 1 tli i%\ 










37.7 


- 0.7 


Quartar of Application 


38.3 


37.7 


♦ 0.6 


37.0 


Quartar 2 


27.0 


28.5 


- 1.6 


23.3 


28.5 


- 5.2 


Quartar 3 


18.8 


21.8 


- 3.1 


17.6 


21.8 


- 4.2 


Quartar 4 


14.2 


15.5 


- 1.3 


12.8 


16.5 


- £.8 


Quartar 6 


11.1 


8.3 


♦ 2.8yy 


11.7 


B.3 


♦ 3.4 


Quartar 8 


10.3 


7.8 


♦ 2.4 


11.4 


7.8 


♦ 3.6 


Avaraga Total UI BanaHta, 












-61.56 


Quartara 1 - B [*] 


1071 .13 


1022.74 


«• 48.38 


871. 1B 


1022.74 


Avaraga Total UI Banaflta [•] 












-60.72 


Quartar of Application 


348.21 


348.65 


- 1.44 


288.83 


348.66 


Quartar 2 


£55.23 


265.17 


- 28.84 


262.12 


265.17 


-23.05 


Quartar 3 


180.01 


163.88 


- 3.65 


15B.68 


183.86 


-26.08 


Quartar 4 


118.15 


80.20 


«• 37.86y 


82.84 


60.20 


♦ 2.64 


Quartar 6 


83.13 


67.81 


♦ 16.32y 


82.41 


67.81 


♦14.58 


Quartar 6 


86.40 


56.25 


♦ 30.14 


88.28 


68.25 


♦40.04* 


6aapla 61za 


B35 


3? 4 




318 


314 





(con tl nuod] 
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Tibli 0.3 (contlnutd) 



SOURCE i NDRC otloulttlont froa Untaployatnt Xnturtnct bimflti rtccrda froa tht Stttt of Ctllfcrnlt. 

HDTESi Tht ftrtt aonth of tht quartar of oppUootlon la tht aonth In ahlch tn Individual att randoaly 
aaatgnad. Thttt dttt Inoludt xtro valuaa for ttaplt atabtrt not racalvlng UI btntfltti Thttt dttt trt 
ragraaa 1 cn-adj utttd utlng ordlntry Itttt aquaraa» controlling for pra-appl Icttl on ch trtcttr I tt I ct of ttaplt 
atabtrt. Prior UZ btntflt rtotlpt att not Includtd tt t rtgrtttlon control. Thtra aty bt toat dl tcrtptnol tt 
In etluolttlng tuat tnd dlfftrtnott dut to rounding. 

Only 18 aontht of folloa-up It av a 1 labia for Itttr appllcanta. 

A tao-tallad t-taat att tpplltd to dlfftrtnott bttattn txptrlatnttl tnd oontrol groupa. 
Statistical tlgnlflctnot lavala trt Indlotttd ttt * ■ 10 ptrctnti ** « 5 ptrotnti ••• » 1 parcant. 

A tao-tallad t-taat att tpplltd to dlfftrtnott In laptctt bttattn application ptrlodt. 
Statistical tlgnlflotnot Itvtlt trt Indlotttd ttt y « 1D ptrctntf yy « 5 porcantt yyy ■ 1 ptrctnt. 
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TABLE 0.4 



SAN 0IE90 

AFOC-U APPLICANTS; SELECTEO IMPACTS OF JOB SEARCH-ENEP ANO JOB SEARCH, 
BY PRIOR YEAR EMPLOYMENT STATUS 
(OCTOBER 1882 - AUGUST 1883 IMPACT SAMPLE) 

~T — 1 1 





Prior 
Eapl oy- 


Job 


8aarch - 


EWEP 


Job Search 


Outcoae and Follow-Up Period 


aan t 


Experimental 


Control 


01 ff aranca 


Exparlaantal 


Control 


01 f faranca 


Ever Eaployed* 


Nona 
Soaa 


67.3 
83.8 


54. B 
81.1 


♦ 2.8 
♦2.7 


58 .7 
78.6 


54.8 
81.1 


♦5.0 
-1.6 


Avoroge Nuaber of Quartara With 
Eaployaentt Quartara 2-8 


Nona 
Soaa 


1.76 
2.80 


1.62 
2.85 


♦0.13 
♦0.05 


1.78 
2.84 


1.82 
2.66 


♦0.16 
-0.01 


Ever Eaployad In 
Quarter 8 (X) 


Nona 
Soaa 


32*0 
81.5 


38.3 
82.1 


—6 . 3 
-0.5 


37.4 
80.4 


38.3 
62.1 


-0.8 
-1.7 


Avaraga Total Eerntnge, 
Quartara 2-8 (•)" 


Nona 
Soaa 


4537.85 
8480.25 


3872.21 
8402.10 


♦585.74 
♦ 78.15 


3832.12 
8856.80 


3872.21 
8402.10 


- 40.08 
♦554.81 


Avaraga Total Earntnga In 
Quartar 8 (1) 


None 
Soaa 


1021.75 
2148.36 


1024.72 
2137.85 


- 2.87 
+ 11.41 


1007.14 
2185.46 


1024.72 
2137.95 


-17.68 
♦27.51 


Avaraga Nuaber of Mentha Raoalvlng 
AFOC Payaanta, Quartara 1-8 


Nona 
Soaa 


7.28 
6.31 


8.78 
7.00 


- 1.48*** 

- 0.70«* 


7.26 
t».45 


8.78 
7.00 


-1.62*** 
-0.68* 


Evar Received Any AFOC Peyaente In 
Quartar 6 (X) 


Nona 
Soaa 


27.2 
31 .4 


35.2 
32.2 


- 8.0«* 

- 0.8 


30.3 
27.0 


35.2 
32.2 


-4.8 
-6.2«« 


Avaraga Total AFOC Payaanta 
Received, Quartara 1-6 (1) 


Nona 
Soaa 


3886.82 
2820.68 


4807.84 
3154.83 


-1020.81***yy 
- 334.25«« 


3883.30 
.2802.33 


4807.84 
3164.83 


-1014.63«**yy 
- 262.60 


Avaraga AFOC Payaanta Raoalvad In 
Quartar 6 (1) 


Nona 
Snaa 


388.88 
407.44 


558.88 
434.85 


-158.88*"y 
- 27.51 


465.38 
353 .48 


558.88 
434.86 


-84.61 
-81. 46«* 


Saaple Slza 

Hava No Prior Yaar 
Hava Soaa Prior Yaar 


Eapl oyaant 
Eapl oyaan t 


388 
880 


233 
580 




238 
583 


233 
680 





80URCE i 8aa Tabla 4.2. 

N0TE8I Coamolanta of ragraaalon control varlablaa ara oonatralnad to equality aoroaa reeeerch groupa and aubgroupa. 

i « i * h * «o-tallad t-taat ... applied to dlffaranoaa In I. pacta between eubgroupe. Stetletlcel eigntrte.no. level. 
Indicted aai y - 10 parcent| yy ■ 5 paroent| yyy - 1 percent. 
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TABLE 0.5 



8AN 0IEG0 

AFOC-U APPLICANTS » SELECTEO IMPACT8 OF JOB SEARCH- EWEP ANO jJOB SEARCH, 
BY PRIOR UNEMPLOYMENT IN8URANCE BENEFIT8 RECEIPT 
(OCTOBER 1962 - AUBUST 1B83 IMPACT 8AM PLE ) 





Prior ur 

D 

Benaf Its 


Job 


8eerch - 


EWEP 


D ut cob e e no roil ow — u p re noa 


Expe r 1 Be nte I 


Control 


Difference 


Evar Eaployed. Quarters 2 - 6(X) § 


None 
8 on e 


72.9 

OR A 

oo . «* 


69.0 

DC Q 
DO iu 


+3.9* 

4-0.0 


Average Nuaber of Que r ter s^W 1 t h 


None 
8oae 


2.40 
3.04 


2.29 
3.06 


+0.11 
-0.01 


Evar Eaployed In 
Quarter B (X) 


None 
Bow B 


46.6 

pe q 
DOiO 


50.5 


-1 .6 
-2.5 


Avaraga Total Eernlnge, 

Ana « frail a O _ Q f £ \ 

Quarters c o i»j 


None 
8 on e 


6591 .01 
9412.37 


6181 .69 
8574.67 


+399.12 
-162.30 


Avorage Totel Earnings In 
Quarter S {$) 


None 
8 ob e 


1613.26 

O Aft R RR 


1544.63 

OR 0 R A7 


+ 68.43 
-1 22.62 


Average Nuaber of Months Receiving 


None 
8 one 


6.79 
6.04 


7.67 
6.60 


-1.08*** 
-0.56 


Ever Received Any AFOC Peyaent* In 
Querter 6 (X) 


None 
Bone 


31.3 
27.3 


34.4 
29.7 


-3.1 
-2.4 


Averege Totel AFOC Payaente 
Received, Quertere 1 - 6 (!) 


None 
8obb 


3294.39 
2664.55 


3955.74 
2666.61 


-661. 35*** 
-224.06 


Averog* AFOC Peyaente Received In 


None 
8oae 


423.23 
356.82 


512.22 
365.90 


-88.99** 
- 8.98 


Saaple 81ze Received No Uneaployaent 

Ineurence Beneflte 


1003 


5 63 




Received Bone Uneaployaent 
Ineurenoe Benefits 


373 


230 





(contl nued ) 
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TA8LE 0.5 [continued] 





I 

Prior UI 
Benef Its 


Job-Search 


Outcome and Follow-Up Period 


ExpeHaentol 


Control 


01 f f er ence 




None 

0 n m m 
ODID 


71.0 
81 .7 


69.0 
85.3 


+2.0 
-3.8 


Averege Nuaber of Quarters With 
Eaployaent, Quarters 8 - 6 


None 
Soae 


8.38 
8.86 


8.89 
3.06 


+ 0.09 
-0.10 


Ever Eapioyed 1n 

f) ti ■ r t a r R f¥l 


None 

fl n ■ ■ 

O U ■ O 


48.4 
65.5 


50.5 
67.8 


-1 .1 

-8.3 


Averege Totel Earnings, 
Quertera 8-8 [•]* 


None 
Son e 


6684.54 
9868.68 


6181 .89 
9574.67 


+438.64 
+899.08 


Average Total Earnings In 
Dm r tip b rai 


None 
8 oa e 


1588.48 
8477.58 


1544.63 
8589.47 


+43.66 
-50.88 


Averege Nuaber of Months Receiving 
AFOC Poyaente, Quarters 1-6 


None 
Soae 


6.53 
7.06 


7 .97 
6.60 


-1 .34**»yyy 
+0.46 


Ever Received Any AFOC Payments 1n 
Quarter B f %1 1 


None 
Soae 


87.1 
30.4 


34.4 
89.7 


-7.4"« 
+0.6 


Averege Totel AFOC Peyaents 
Raoelved, Quarters 1-6 [S] 


None 
Some 


3183.48 

O 1 DC . C 4 


3955.74 

c o bo .61 


-778.88***yyy 

4.0QQ CO 
TCOJ i DO 


Averege AFOC Payaente Received In 
Querter 6 ($] 


None 
Soae 


373.38 
416.88 


518.88 
365.90 


-138.85***yy 
+ 50.88 


8aapla 81ze Received No Uneaployaent 

Ineurence Benefits 
Received Soae Uneaployaent 
Ineurenoe Benef 1 t s 


588 

833 


5 93 
830 





SOURCE AN0 N0TESI See Teble 4.8. 



Prior UI Benefits ere only observed for the el x aonthe prior to 

oppHcetlon. 

Coefficients of regression control variables ere eonstrslned to 
equellty across reeeerch groupe end ecroee subgroups. 

A two-tolled t-teet wee epplled to differences In lape.cto between 
subgroups. 8tet1et1cel significance levele ere Indicated eex y = 10 percent; yy = 5 
percent! yyy = 1 peroent. 
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TABLE 0.6 



SAN 0IEG0 

AFOC-U APPLICANTS! SELECTEO IMPACTS OF JOB SEARCH-EWEP ANO JOB SEARCH, 

BY NUMBER OF CHILOREN 
(OCTOBER 1BB2 - AUGUST 1863 IMPACT SAMPLE ) 

' 1 r 



Outcoao and Follow-Up Period 


Nuabor 

of 

Children 


Job Soorch - EWEP 


Job 8eerch 


Exporlaontol Control Difference 


Exporlaontol Control Olfforonco 


Evor Eeployed* 
Quirtin 2-6 

MMOJlorOJloj ew W | A J 

Avaraga Nuaber of Quartara With 
Eaployeent, Quartara 2-6 

Evor Eaployod In 
Quarter 6 [%) 


Ono 

Moro thon Ono 
Ono 

Moro thon Ono 
Ono 

Moro thon Ono 


77.0 72.6 +4.4 

76.0 74.1 *1 .8 

2.63 2.31 +0.31**yy 
2.65 2.58 -0.04 

61.2 52.8 -1.7 

54.1 56.5 -2.4 


75.5 78.6 +3.0 

73.1 74.1 -1.0 

2.58 2.31 +0.28*y 
2.51 2.58 -0.08 

54.6 5£.8 +1.8 

53.2 66.5 -3.2 


Avaraga Totol Eernlnge, 
Quartara 2-6 {$}* 

Avorogo Totol Eornlngo In 
Quortor 6 ($J 


Ono 

Moro thon One 
Ona 

Moro thon Ono 


6718.82 5226.82 +1482.80**yy 
7675.00 8040.44 - 365.44 

1543.80 1428.68 +114.24 
1868.40 200B.86 - 40.46 


6576.65 5225.92 +1350.72* 
7884.80 8040.44 - 55.54 

1573.43 1428.66 + 143.77 
1862.75 8008.86 - 47.11 


Avorogo Nuaber of Montha Receiving 

Evor Rocelvod Any AFOC Peyeente In 
Quortor 6 {%) 


Ono 

Moro thon Ono 
Ono 

Moro thon Ono 


6.28 7.06 - 0.78* 
8.73 7.71 - 0.88*** 

28.1 28.8 - 0.8 
30.8 34.5 - 3.7 


6.31 7.06 -0.75 
6.66 7.71 -0.85** 

27.0 28.8 -3.0 
26.4 34.5 -6.1** 


Averege Totol AFOC Peyeente 

Averogo AFOC Peyeente Rocolvod In 
Quarter 6 (•) 


Ono 

Moro thon Ono 

Onoo 

Moro thon Ono 


2634.76 3030.13 - 385.37 
3363.68 3848.74 - 585.05*** 

330.42 381.57 - 81.15 
442.28 512.83 - 70.53* 


2668.42 3030.13 -360.70 
3438.81 3848.74 -508.83*** 

331.88 381.57 - 47.66 
410.88 512.B3 -101.85** 


8aeple Size 

Ono Child 
More Then Ono Child 


453 245 
824 567 


286 245 
535 567 



SOURCE t Soo Toblo 4.2. /3 9 O 

NOTESs Coefficient! of rogrooolon control vorlobloo are conotralnod to equality ocroao research groupo end oubgroupo. 

The More- Then-One- Child cotogory contolne o oaoll nuabor of Indlvlduolo olth zero for nuabor of children. 

A too-tolled t-teet eoe applied to differences In lapocto between oubgroupo. 8totlotlcol elgntftcence lovolo 
Indicated oos y = 10 percent} yy « 5 percent) yyy = 1 percent. 
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TABLE 0.7 



SAN DIEGO 

AFDC-i) APPLICANTS! WELFARE RECIDIVISM, BY RESEARCH GROUP AND APPLICATION PERIOD 
(OCTOBER 1982 - /MUST 1983 IMPACT SAMPLE) 





October 1982 - 


wren 1B83 


April 


- August 1983 


I 

October 1982 - August 1983 


HoCIOlViV StfttUB 


Job Seerch- 
EKEP 


Job 
Search 


control 


Job Search- 

mm 
CTtP 


Job 
Search 


Control 


Job Seerch- 
EWEP 


Job 

Search 


Control 


I 

M*l fan* Difli<tlu<M tW\ 
WBlTorB HBOIOIV 1M I* J 


17.1 


16.6 


18.0 


1B,1 


16,4 


17.2 


17,8 


16,5 


16,5 


IHthln ths Six Quarter 
FolloHJp Period! [X] 




















On Welfare* Sobs Off end 
Never Returns 


45,9 


47.6 


43,1 


48.8 


43.7 


47.5 


46.9 


46.1 


44.8 


Alley e on Mel fere 


18,5 


18.1 


83.4 


18.7 


15.4 


19,4 


17,7 


17.1 


21.9 


Never on Mel fere 


18,5 


17.7 


17.4 


17.0 


24.5 


15,9 


17.9 


20.3 


16.9 


8aple Size 


741 


513 


499 


635 


318 


314 


1376 


831 


813 



SOURCE! MDRC celouletlone free County of Sen Diego eel fare records free the EPP Infometlon Syetet. 

B 

An Individual le considered e velfere recidivist if he/she Is on eel fere, goes off eel fere, end then returne to eel fere 

i 

emetine ilthln six quertere of follw-up, The quarterly eel fere inforietlon, hteever, does not pick up nonthly Movement on end off 
the rolle. 

These Mgureetere not regreeslon-sdjusted, 

None of the differences siong rsseerch groups eers stetlBtlcelly significant et the 10 percent level using e txo-telled 

t-teet, 



Teste of etetlstlcal significance beteeen application periods eers not calculated. 



TABLE O.B 



SAN 0IE60 

AFOC-U APPLICANTS; EST I HATEO REGRESSION COEFFICIENTS FOR TWELVE-MONTH FOLLOW-UP, 

SELECTEO EMPLOYMENT ANO WELFARE MEASURES 
(OCTOBER 19B2 - AUGUST 19B3 IMPACT SAMPLE] 



Variable 


Ever Employed 
In Quarter 6 


I 

Earnings In 
Quarter 6 


I 

AFOC Recel pt 
In Quarter 6 


| 

Totel AFOC 
Payments In 
Quarter 6 


Job Saarch-EWEP 


-2.2 
(2.1 ] 


+ 7.29 
(99.75] 


- 2.9 
(2.0] 


- 65. 06** 
(30.85] 


Job Search 


-1.5 
(2.4] 


+ 14.62 
(111. 29} 


- 5.1** 

(2.2] 


- B4.8B** 
(34.52] 


a 

San Olego West 
Oceanai da 










+ 7.7* 
(4.0] 


+225.97 
(1B7.23] 


- 10. 0*** 

(3. 7] 


-213.39*** 
(5B.08] 


San Olego Eaet 


+8.4*** 

13.5] 


+594. 33*** 
(163.62] 


- 3.B 
(3.3] 


- B4.52* 
(50. B5 ] 


Service Center 


+5.7* 
(3.2] 


+37B.68** 
(150.38] 


+ 0.2 
(3.0] 


- 22.51 
(46.66] 


Eecondl do 


+10. 5*** 
(3.5] 


+372.24* * 
(165.81 ] 


- 14. 6*** 

(3.3] 


-255. 10*** 
(51 .47] 


South Bay 


+3.7 
[3.2) 


+322.06** 
(14B.40] 


- 2.B 
(2.8] 


- 37.72 
(46.04] 


EL Cajon 


+8.3*** 
(3.1 ] 


+564. 80*** 
(146.84] 


- 1 .4 
(2.8] 


- 61.61 
(45. 5B] 


Age 24 Yeara or 

L888 


+4.2* 
(2.3] 


-10B.51 
(10B.40] 


+ 1.7 
(2.2] 


+ 4.31 
(33.63] 


Age 25-34 Years* 
Age 35-44 Yeara 










-1 .6 
(2.6] 


- 72.37 
(121 .64] 


- 1.2 
(2.4] 


- 1.26 
(37.73] 


Age 45 Yeara or 
More 


-5.3 
(3.9] 


-2BB.3B 
(1B3.72] 


- 0.4 
(3.6] 


- 28.17 
(56.88] 


FeaaLe 


-B.2** 

(3.5] 


-613. 25*** 
(165. B4] 


- 3.4 
(3.3] 


-104.41** 
(51 .45] 



( contl nued ] 
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TABLE D.6 (continued] 



Vsrleble 


Ever Employed 
In Querter 6 


Earnings In 
Quarter 6 


I 

AFOC Receipt 
In Querter 6 • 


I 

Total AFOC 
Payments In 
Querter 6 


White, Non- 
e 

Hlepenl c 


















BLeck, Non- 
Hi sponl c 


+ 1.7 
(3. 4] 


-214,91 
(157.98] 


+ 8.8*** 
(3.1 ] 


+170.25*** 
(48.01 ] 


HI spen 1 c 


+9.2*** 

(2.3] 


+245.44** 
(108.81 ] 


+ 4.5** 

(2.2] 


+ 58.20* 
(33.78] 


Other Ethnic 
Groups 


+ 3.5 
14.1] 


- 28.35 
(192.00] f 


+ 3.3 
(3.8] 


+ 84.57 
(58.56] 


High School 
OlpLono or 
General Equival- 
ency Olplone 


+4.0** 

(2.0] 


+207.16** 
(82.08] 


- 5.5*** 
(1.8] 


- 86.68*** 

(28.57] 


Never Married 


-4.7 
(3.6] 


-288.17* 
(168.78] 


+ 14.2*** 

(3.4] 


+214.51*** 

(52.36] 


Married, Living 
With Spouse 


















Merrled, Not Liv- 
ing With Spouse 


•8.3 
17.1] 


-176.47 
(334.05] 


+ 14.4** 

(6.6] 


+211 .77** 
(103.63] 


Olvorced or 
Widowed 


-1.5 
(6.6] 


-408.17 
[311. 02] 


+ 13.9** 
(6.2] 


+160.62* 
(86.48] 


Number of Child- 
ren Lees Then 
18 Years Old 


+ 0.6 
(0.8] 


+107.88*** 
(37.88] 


+ 1.8** 
(0.8] 


+ 60.02*** 
(11 .78] 


Any Children Less 
Then 6 Yeers Old 


-0.8 
(2.5] 


-112.24 
(116.31 ] 


+ 4.6** 

(2.3] 


+ 63.14* 
(36.08] 


a 

Never on AFOC 


















On AFOC Two 
Years or Leer 


-1 .8 
11.8] 


-134.17 
(88.56] 


+ 8.7*** 
(1.8] 


144,30*** 
(27.78] 


On AFOC More 
Then Two Yeers 


-2.5 
(3.8] 


-183.02 
(185.03] 


+ 16.0*** 

(3. 7] 


+241 .32*** 
(57.40] 


Held e Job During 

Four Quarters 
Prior to 
Appl Icetlon 


+15.8*** 

(2.3] 


+135.88 
(110.08] 


+ 5.8*** 

(2.2] 


+ 26.42 
(34.15] 



( contl nued ] 
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TAul E O.B (continued] 



Varleble 


Ever Employed 
In Quarter 6 


Eernlnge In 
Querter 6 


AF0C Recel pt 
In Querter 6 


Totel AF0C 
Payments In 
Querter 6 


TotoL Eernl nge 

flu p 4 n n Pnui* 
uu r i ii y r u u i 

Quarters Prior to 
Application (In 
Thouaande of 
Ool lare) 


(0.1) 


(6.92) 


_ n 7 * * * 

Urn/ 

(0.1 ] 


_ 44 PA*** 

(2.15) 




+26 .7*** 
(4.4) 


+553.15*** 

• WWW. t ■* 

(206.03) 


+ 24.7*** 
(4.1 ) 


+356. 47*** 
(63.61 ] 


Number of 
Obae rv at 1 one 


3020 


3020 


3020 


3020 


R Square 


.0656 


.1557 


.0642 


• 0746 


Oependent Varle- 
ble Average 


53.9 


1B26.42 


30.4 


417.49 



SOURCE: H0RC celculetlone from County of Sen Oleno welfare records end 
Unemployment Insurance earnings records from the EPP Information System. 

NOTESs Somple sizes for the AF0C-U group ere ee foLLowe: 1376 Job 
Seerch-EWEP Exp& r 1 men te L s ; 631 Job Search Expe rl mentaL a ; and 613 Controle. 

Regressions presented In th1 s table correspond to Impect estimates 
presented In teble 4.2. 

Estimated stendard errors ere In parentheses. Lev el e of 
etetlatlcal el gnl f 1 canoes * = 10 percent; ♦♦ = 5 percent; *** = 1 percent. 

These date Include zero values for eempLe membere not employed end 
sample members receiving weLfere. ALL regression estimates ere by ordinery Leest 
aquaree. 

*Where ambiguities may arise, reference groups for categorical 
variable© are Indicated by dashes in the tebLe. 
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APPENDIX E 
QUALITY OF EPPIS FILES 



The evaluation of the San Diego programs involved several data 
sources, as described in Chapter 2. In order to ensure the integrity of 
the data ool lection procedure, different strategies were used to assess the 
quality of the data and to identify any sources of bias. 

The major data source was the EPP Information System (EPPIS) that 
combined individual program tracking, DI earnings and AFDC payment records 
for each sample member into one file. These independent data sources were 
linked by either Social Security number and/or welfare case number. The 
State of California was responsible for producing this EPPIS file and 
merging it with MDRC's Client Information Sheet (CIS). Throughout the 
demonstration, the state updated the EPPIS/CIS data file by overlaying the 
most recent five quarters of earnings data and adding the most recent month 
of welfare and program tracking data for each sample member onto the 
existing file. In some cases, corrections were made to the data in prior 
months. 

The EPPIS/CIS data file was sent to MDRC upon request, where extensive 
work was done to analyze the quality of the data, including checks on 
sample sizes, demographic characteristics, tracking information, earnings 
records, and AFDC data. Sample sizes, demographic characteristics, and 
selected unadjusted impacts were compared across files to identify any 
discrepancies. The file used for this report was consistent with previous 
files as well as data presented in the second report, which indicates that 
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the file used for this report was in fact merged properly, and its data 
were reliable. 

Welfare Payments Records 

TWO issues were of particular importance for the welfare payments 
data. One was possible bias in the distribution of months in which welfare 
payments were missing that is, neither a zero nor a positive amount was 
recorded. This examination of missing data uncovered no biased distribu- 
tion among research groups. The second concerned the possibility of bias 
resulting from a concentration of missing data at a particular amount (zero 
dollars). The data suggested no such bias. 

In addition, two special efforts were made to check the quality of 
these data. One involved comparing the welfare data in EPPIS with those on 
microfiche maintained by the County of San Diego; the other involved 
matching EPPIS welfare payment amounts with those recorded in the local 
welfare case files. Both procedures indicated that the EPPIS welfare 
payments data were reasonably accurate, with minimal problems related to 
incorrect case number matches. 

PI Earnin gs Records 

Special attention was paid to the quality of the 01 earnings data in 
light of the different employment and earnings behavior of the early and 
later applicant samples. Earnings data from the Unemployment Insurance 
(DI) system requires employers to report employee earnings on a quarterly 
basis in order to determine 01 eligibility and employers' tax liability for 
Unemployment insurance benefits. In contrast to the welfare payments, 
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there is no distinction in the EPPIS file between zero earnings and missing 
data (possibly caused by a mismatch of Social Security numbers). Thus, the 
issue here concerned any bias resulting from using Social Security numbers 
recorded on EPPIS and/or MDRC's CIS to match sample members to the 01 
system. There was particular concern over the possibility of incorrect 
Social Security numbers. Two manual checks were done of the EPPIS earnings 
data — one for the second report and one for this report. This involved 
comparing the earnings recorded on the EPPIS files for a random subsample 
of individuals with those obtained for the same individuals through the 
regular 01 inquiry system used to process 01 claims. Both of these checks 
confirmed the integrity of the matching process and the accuracy of the 
EPPIS files for 01 reported earnings. 

To further confirm the quality of the 01 earnings records, additional 
quality checks were then done using other data sources. First, earnings 
reported by individuals on the six-month applicant survey discussed in 
Appendix B were matched to those reported by EPPIS using 01 records. This 
analysis was done across application periods and research groups to check 
for differences in the existence of uncovered employment (i.e. employment 
reported on the survey that was not picked up by the 01 system). No 
significant differences between research groups were found, although around 
20 percent of the employment reported by applicants was not reflected using 
the 01 data. Furthermore, there was no real difference between research 
groups or application periods in the types of uncovered jobs individuals 
had. 

Earnings data were also compared between the CIS form and the 01 
system to examine the extent of under-reporting using sample member 
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self-reported information on employment prior to random assignment. 
Although there was a discrepancy of about 20 to 25 percent between UI and 
CIS reported employment, this can be attributed in part to recall error in 
the CIS data and reporting lags in the UI system. 

These investigations show that the State of California's EPPIS file 
successfully merged three major data sources for each sample member and 
that the impacts found for the Job Search group across application periods 
are not due to computational error or data file problems. 



237- 

306 



APPENDIX F 



-239- 

307 



9 

ERIC 



APPENDIX F 
SENSITIVITY OF THE BENEFIT- COST RESULTS 



As discussed in Chapter 5, the benefit-cost analysis made *any 
different assumptions. This appendix tests the sensitivity of the overall, 
or "benchmark, " results to changes in key assumptions needed to estimate 
impacts, to value both the output produced in regular jobs in the labor 
market and the output produced in EWEP assignments, and to extrapolate 
program benefits beyond the observation period. For each test, one 
assumption is modified and the net present values are recalculated for each 
of the programs and assistance categories. The results of these tests are 
presented in Tfeble F.1 along with the "benchmark" results presented in 
Chapter 5. 

Impact Estimation. The estimates of program effects used in the 
benefit-cost analysis are unadjusted experimental-control differences in 
outcomes rather than the regression-adjusted earnings and welfare estimates 
reported in Chapters 3 and 4. For the reasons discussed in Chapter 5, 
making adjustments in all benefit and cost components that are comparable 
to those used in Chapters 3 and 4 would require additional analysis that is 
beyond the scope of this evaluation. 

While regression adjustments have not been used in computing the 
overall net present value estimates, it is possible to test the sensitivity 
of the overall results to using regression- adjusted estimates for earnings 
and welfare payments only. This is the first test presented in Table P.I. 
The adjustments change the overall estimates by between $77 and $634 per 
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TABLE F.1 



SAN DIEGO 



NET PRESENT VAtUE EST I HATES UNDER ALTERNATIVE ASSUMPTIONS 
BY RESEARCH GROUP, ACCOUNTING PERSPECTIVE AND ASSISTANCE CATEGORY 





Job Search - ENEP 


Job Search 






Accounting Perspective 




Accounting Perepective 




Eotiaetion Assumptions 


Social 


Appl leant 


Texpayer 


aOCl a I 


flppi i cant 


Tsxpeyer 


Binchiirk Estiiste 














for AFDC Appticinti 


11952 


$797 


11155 


11096 


$644 


1452 


AltirnatWa Aiauiptiom for 














AFHP Annl 1 r in t ■ 
nrvw nupiibiiiti 














Benefits Rsgrsssion-Adjusted 




11 


I10 r >8 


1650 


$451 


1199 


Dlsplacssent a 501 


1C22 


797 


224 


446 


644 


-194 


Vatim of Cutout deluded 


1747 


797 


950 


1099 


644 




No Dacav of Banaft'i 


2193 


748 


1445 




497 


B AO 

646 


Annual Decay of Bsnsfits " 22* 


1B38 


629 


1209 


ODD 


m r 


521 


Nc Extrapolation of Bsnsftts 


599 


216 


383 


352 


266 


Bo 


Dt ■count Rata * 101 


1B37 


748 


1091 


1033 


612 


421 


D1 ■count Rata = 0 


2070 


852 


1223 


1167 


679 


488 


Tiaa Horizon * B Yssrs 


2424 


1023 


1401 


1RR7 


i uoc 


C c c 

555 


Banchaerk Eatiiata 














a 

for AFD1-U Applicants 


-129 


-11443 


11414 


143 


-$1196 


$1238 


Alternethe Aaauiptlona for 














AFOC-U Applicants 














Banafita Ragreeelon-AdJ ueted 


-1224 


-11366 


11142 


$446 


-1649 


$1094 


Diaplocaaant = SOX 


-83 


-1443 


1360 


-129 


-1186 


1067 


Valua of Output Excluded 


-3B3 


-1443 


1060 


38 


-1196 


1234 


No Dacay of Banafita 


-117 


-1B29 


1713 


196 


-137B 


1572 


Annual Dacay of Banafita * 22X 


-BO 


-1543 


14B3 


114 


-1197 


1311 


Ho Extrapolation of Banafita 


135 


-553 


680 


-175 


-564 


3B9 


Dlicount Rata » 101 


-13 


-13B7 


1354 


24 


-1143 


1167 


Diicoun', Rata = 0 


-44 


-1526 


1482 


63 


-1255 


1316 


llaa Horizon = 8 Yaara 


-56 


-1707 


1651 


88 


-1460 


1548 



SOURCE t HDRC colculetiono froi Uneiployient Inaurence records; AFDC dete; applicant survey) aorkaits eurvey; EPP 
Inforielion Syetei snrollisnt dete; EPP, EVEP, WIN* and JTPA progrsn coet records; end publiehad dete on lelfsre casta, tex 
rateii end eiployee fringe benefited See text for descriptions of these eourcas. 



NOTESs 'The "benchierk" eetlietee are thoee preeented in Tiblee 5.8 end 5i9, In asking thaee eetlietee, unadjueted 
experlRentel-control differancee in outooaae sere ueed to coiputi all bsnaflte; It vee assumed that thsrs ass no displsceasnt 
ceueed by the progreia; end eeeuiptione regerdfng I aspect dacay t t hi discount rsts and the tin horizon for extrapolation lare 
uaed to coapute poet-obeervetion benefite (theee sssuiptions ere dsscribsd in Ssction B,5 of ths tsxt). 



mc 309 



experimental, but do not substantially change the qualitative conclusions 
that have already been reached. For the AFDC assistance group, the changes 
make the Job Search/EHEP program appear somewhat more effective (except 
from the taxpayer perspective) and Job Search only somewhat less effective. 
For the AFDC-U v s y the changes have the opposite effect: the value of Job 
Search/EWEP is reduced and the value of Job Search is increased (except 
from the taxpayer perspective). 

Displacement. One important assumption used in the analysis is that 
the increased employment of experimental s does not result in the 
displacement of other workers. To the extent workers are displaced and do 
not gain employment elsewhere, society loses the output they would have 
produced. The second sensitivity test in Table F.1 assumes that such 
displacement does occur and that the value of the lost output is half of 
the net output generated by the programs. Although this alternative 
assumption is extreme, even it does not change the conclusions except in 
two cases. The taxpayer group — which includes the displaced workers — 
loses income; the loss is large enough for AFDC applicants assigned to Job 
Search to change the value of the program to taxpayers from positive to 
negative. Applicants are not affected. The social net present value of the 
program drops somewhat because the loss to taxpayers is not offset by any 
gain to applicants. In the case of the AFDC-U applicants assigned to Job 
Search, the loss is large enough to change the social net present value 
from positive to negative. 

Another way of assessing the sensitivity of the results to the 
displacement assumption is to calculate the amount of displacement that 
would be needed to change any of the benefit-cost conclusions. For the 
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AFDC group assigned to Job Search, displacement of about 20 percent would 
do this, while 40 percent would be necessary to change the conclusion for 
AFDC-0 applicants in Job Search. More than 70 percent displacement would 
be required to change the social net present value of Job Search for AFDC 
applicants, and the social and taxpayer values of Job Search/EHEP for the 
same group. None of the other conclusions change regardless of the 
assumption made. 

Value of EWEP Output . The second assumption is that the social demand 
for EWEP services is equal to the supply price of the alternative labor 
that would be needed to produce the same services. However, this 
assumption may well not be true. Indeed, it is likely that the demand 
value of the services is at least slightly below the supply price. 1 Thus, 
the third sensitivity test in Table F.1 assumes that the value of these 
services is zero, obviously an extreme assumption. This alternative 
assumption reduces the value of the Job Search/EHEP sequence to taxpayers 
and society, but again the conclusions remain the same. 

Extrapolation The extrapolation of observed benefits into the 
future, which involved assumptions regarding four different extrapolation 
components, was clearly important to the overall results. One of these 
assumptions was that the last two quarters of observation constitute the 
best base period for extrapolation. Because these data are based on the 
full sample of experimentals and controls and represent the most recent 
evidence that is available for the programs, they probably are the best 
data available — particularly since using only the last quarter for the 
base might introduce seasonality issues. The assumptions regarding the 
decay rate, discount rate, and time horizon are all subject to greater 
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uncertainty. 

The assumption regarding the decay rate was that the same base impacts 
would decay at the same rates observed for earnings and welfare receipt 
between quarter 2 or quarter 3 and the end of observation. Sensitivity 
tests of three alternative assumptions are presented in Table P.1. The 
assumption of zero decay raises the estimates of benefits and therefore 
increases the estimates of social net present value for all groups except 
AFDC-D applicants in Job Search/EHfEP; in that case, since the base-period 
earnings estimate was negative, extrapolating it without decay makes the 
negative overall social value even more substantial. An assumption of a 
constant annual decay rate of 22 percent for all benefit components — 
which is consistent with previous research on the impacts of the WIN 
program 2 — increases or reduces the t£t present value estimates depending 
on the group and the perspective. The largest change, however, is a less 
than $200 reduction in the net value of Job Search to AFDC applicants. 
Finally, no extrapolation of benefits — which is equivalent to applying an 
infinite decay rate — reduces all net value estimates for the AFDC group, 
in some cases substantially. Not extrapolating the negative earnings found 
for the AFDC-D 1 s assigned to Job Search/EWEP makes the social value 
positive for that group. 

A discount rate of 5 percent was used to calculate the benchmark 
results. The sensitivity tests reported in Table F. 1 uses alternative 
rates of zero and 10 percent. These two alternative assumptions change the 
overall results relatively little. 

In some cases, the dollar estimates proved to be sensitive to the 
choice of a time horizon. A horizon of 5 years — the average time a 
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family remains on AFDC — was used for the benchmark estimates. A shorter 
horizon reduces the net present value estimates noticeably except for the 
applicant and social perspectives for the AFDC-U group. Not extrapolating 
benefits — in effect reducing the horizon to the length of observation — 
reduces the estimates by well over 50 percent except for these AFDC-U 
cases. Conversely, extending the horizon to eight years — which 
approximately doubles the length of the extrapolation period — increases 
all AFDC estimates as well as the AFDC-U estimates from the taxpayer 
perspective. However, the overall conclusions of the benefit-cost 
evaluation do not change. 
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CHAPTER 1 

1 . In this report, AFDC (called AFDC-FG in California) refers to 
welfare cases headed by a single parent; AFDC-0 (called AFDC-OP in 
California) refers to two-parent households where the principal 
earner is unemployed. All principal earners must have had some 
oonnection to the labor force during the 12 months prior to welfare 
application. The majority of AFDC-0 cases are headed by married 
men while the heads of AFDC cases are mostly women. When the term 
"welfare* is used in this report, it refers co both the AFDC and 
AFDC-0 programs. 

2. EPP was authorized under California Senate Bill 1476 (Chapter 918, 
Statutes of 1980); EWEP was authorized under California Assembly 
Bill 2X (Chapter 3, Statutes of 1982). The new demonstration pro- 
ject, called the Private Sector Alternative to Welfare Dependency, 
was approved under Section 1115(a) of the Social Security Act. 
EWEP was established as a no-waiver Section 1115(a) project by the 
California Department of Social Services on behalf of the County of 
San Diego. 

3. HDRC also evaluated one part of the EPP Job Search program in San 
Mateo, where applicants and recipients were referred to a group job 
search workshop similar to that run in San Diego. The demonstra- 
tion primarily tested the effectiveness of adding a job search 
reporting requirement after program completion. Its intended 
purpose was to sustain and improve the search skills generated by 
the job search workshop and to continue staff involvement with 
registrants. Cooperation with EPP staff was a condition of 
oontinued welfare receipt. Findings on the San Mateo program are 
presented in a separate document, Price et al., 1985* 

4. Goldman et al. , 1985. The first report published in February 1984 
focused on early operational lessons (Goldman et al., 1984) . 

5. Much of the material on the historical development of the EPP and 
EWEP programs is drawn from a case study prepared by a consultant, 
Harvey Shapiro, for MDRC. 

6. A key element In the bill was to shift responsibility for employ- 
able recipients from DSS to EDD, whereby EDD would issue the 
welfare checks. The intent was to form a closer tie between 
welfare and work by having the department in charge of employment 
issue the grant check. Because of EDD 1 s concern about the 
feasibility of this, EDD takeover of grant payments to employables 
was put off until a second phase. Also, to begin with, pilot 
projects were to be implemented in two counties, although a third 
was added later. 
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7. These figures are calculated from tables published in Public 
Welfare in California. See California State Health and Welfare 
Agency, Department of Social Services, 1984. 

8. MDRC's Demonstration of State Work/Welfare Initiatives is examining 
the implementation, impact and cost- effectiveness of major employ- 
ment programs for the welfare population begun by a number of 
states in response to OBRA. In afiition to San Diego, studies are 
underway in Arkansas, Illinois, Maine, Maryland, New Jersey, 
Virginia, and West Virginia. Process or implementation studies only 
are being conducted in Arizona, Florida and Texas. 

« 

9. Random assignment actually began in August 1982 prior to the final- 
Ization of the program guidelines and research design. However, 
the first two months of the research were considered to be a pilot 
phase, and enrollees during this period were excluded from further 
analysis. While the research sample used in this report was 
selected over an 11-month period, it is referred to as a yearlong 
process. 

10. More applicants were randomly assigned to the Job Search/EWEP 
experimental group than to the control and Job Search only groups 
in order to ensure a sufficient number to evaluate the impact of 
BWEP. 



CHAPTER 3 

1. The efficiency of the estimates is a measure of the variance, or 
statistical uncertainty, surrounding the estimates. The use of 
more efficient estimators makes it less likely that true program 
effects will go undetected. Dsing ordinary least squares to 
estimate experimental-control differences, the regression model was 
run separately for the AFDC and AFDC-D samples. Regressions for 
early and late application periods and for the subgroups used 
interactive dummy variables. Since data for quarters 7 and 8 were 
available only for the early sample, impacts for these quarters and 
cumulatively through quarter 8 were calculated for this early 
sample without using interactive variables. 

2. Two- tailed t-tests were used in making comparisons because 
researchers had no prior assumptions about the way in which 
experimentals might differ from controls or other experimental s. 

3. AFDC-D clients were automatically considered WIN-mandatory. AFDC 
clients were judged WIN-mandatory unless exempted according to the 
criteria described in the WIN Handbook: 

1. under 16 years old 

2. enrolled full-time in s.hool and under 21 years 

3. sick, as determined by the Income Maintenance unit 
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4. incapacitated, as determined by the Income Maintenance unit 

5. 65 years old or more 

6. living in a remote area: located two hours or more away from a 
WIN office 

7. a caretaker of a sick person 

8. a mother of a child under six years of age 

9. a mother or female whose spouse is a WIN registrant 

4. Once individuals were assigned to a research status, they remained 
in that group even if they were deregistered from WIN or EPP and 
re-applied for welfare at a later point. 

5. The State of California cloaned up the BPPIS file so that people 
with more than one Social Security number were counted correctly as 
one case. This accounts for the research sample size difference cf 
seven individuals (7,004 to 6,997) between the second report 
Goldman et al. , 1985 — and the current study. 

6. This group includes unemployed parents who do not meet federal 
eligibility requirements for the AFDC-0 program — primarily the 
requirement relating to length of unemployment — but who are 
eligible for state aid payments for three months. 

7. During the early months of this demonstration, these mandatory AFDC 
applicants were randomly assigned; however, in January 1983, guide- 
lines were changed to exclude this group from random assignment. 
Program operators believed there should be more flexibility in 
serving mothers whose cases included children under six years of 
age. 

8. In San Diego, refugees are referred to a central office for regis- 
tration in order to receive special services designed to meet their 
needs. 

9. During the early months, applicants were randomly assigned to only 
three of the four research groups: Job Search/EHEP experimental s, 
extra experimental s, and controls. Based on the decision to 
analyze EPP Job Search activities separately from EtfEP, the Job 
Search only experimental group was added beginning in October of 
1982. 

10. For example, a 1977 study of tne welfare population Indicated that 
24 percent of the mothers and 17 p*"cent of the fatii^s were at 
least high school graduates, while 31 percent of mothers and 47 
percent of the fathers had held some employment during the two 
years prior to the study. 0. S. Department of Health and Human 
Services, 1980. 

11. This payment schedule was in effect from July 1 , 1984 through June 
30, 1985. From July 1, 1 983 through June 30, 1984, the maximum 
benefit for a family of three in California was $526. Prior to 



-250- 



3 17 



July 1, 1983, this same benefit level was $506. 

12. These figures for state payments are reported in U.S Department of 
Health and Human Services, 1985, pp. 337-8. 

13* For a more detailed description of how grants are calculated, see 
Chapter 3 of Goldman et al., "Relationships between Earnings and 
Welfare Benefits, » 1985. 

14. Ibid. 

15. In July 1984, rules for sanctioning AFDC-U' s while in the EHEP 
component were changed. The federal welfare grant would still be 
closed for the sanctioned recipient of AFDC-U, but the State of 
California would use state funds to continue to give aid to the 
family, excluding the needs of the person sanctioned — in a manner 
similar to the federal AFDC rules. According to the County, the 
AFDC monthly administrative records that are used in this report 
include grants that draw from both federal and state monies. Since 
the change in rules for sanctioning AFDC-U 1 s was not implemented 
until the fall of 1984, it affected only the last few months of 
follow-up for the sample. Thus, sanctioning AFDC-U* s in the EHEP 
component after September 1984 would not result in as large a grant 
reduction as during the earlier period. However, the change 
affected only a small number of people since by this time few were 
still in the EHEP component. 

VS. See Footnote 7. 

17. The samples used in the impact and benefit-cost analyses differ in 
size due to decisions about when to exclude cases that were missing 
data; 11 percent of the members of the research sample were 
eliminated from the impact analysis, and fower, 6 percent, were 
excluded from this benefit-cost study. Since the benefit-cost 
study does not adjust data using regression analysis, sample 
members were not excluded from this study if demographic baseline 
data were missing. In contrast, cases were excluded from the 
impact analysis if information was not available on key demographic 
measures, such as age, ethnicity, marital status, history of 
welfare receipt, prior employment, number of children, and educa- 
tion; on thi? basis, 57 from the AFDC category and 46 from the 
AFDC-U category were excluded. If a case was missing information 
on more than three months of welfare payments, it was excluded from 
tje benefit-cost analysis; this criterion eliminated 204 cases i" 
the AFDC category and 222 in the AFDC-" group. If missing data on 
at least one month of welfare payments, cases wers excluded from 
the analysis of impacts on welfare and UI benefit receipt, 
employment, and earnings; on this basis, 336 cases from the AFDC 
group and 362 from the AFDC-U category were eliminated. 

For both the impact and benefit-cost analyses, cases were elimi- 
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nated if data were missing on basic characteristics such as 
assistance category, research group and month of random assignment. 
In addition, if a case was missing a Social Security number it 
could not be matched to the DI records and thus was eliminated. 

18. In addition to the DI earnings records, two other data sources are 
available for measuring employment and earnings of sample members, 
but both Lave limitations. First, employment data were collected 
by WIN or EPP staff and entered into EPPIS, but there is reason to 
believe that the accuracy of this data source diff ers for experimen- 
tal and controls. Since workshop leaders had the opportunity to 
observe the job search activities of program participants, the 
employment of these participants was much more likely to be 
reported in these records than that of regular WIN registrants who 
are the control group members. Furthermore, EPPIS program records 
do not reflect employment behavior prior to registration and subse- 
quent to WIN or EPP deregistration, and there may be differential 
biases between registration and deregistraton rates of experiment 
tals and controls. Consequently, EPPIS program employment data 
will be used only to measure placement activity, but not as a 
measure of employment impacts. A second source is the six-month 
applicant survey which captures information on the first job held 
within a six-month follow-up period only for those individuals who 
applied for welfare between January and June 1983. 

19. Generally, it appears that EPPIS provides an acceptable measure of 
the extent to which individuals were involved in program activi- 
ties, but there was a lag between the occurrence of an activity and 
its being recorded in EPPIS. Further, there were problems with the 
accuracy of dates. 

20. In the second year report, the 01 benefit impaots were calculated 
using the six-month applicant survey. (See Goldman et al. , 1985, 
PP. 137-148.) In this report, universal data on the full sample 
were available. The percentage of individuals receiving 01 
benefits in the sixth month was fairly similar between the two data 
sources for each research group, although these percentages were 
consistently higher using the 01 benefit records. For example, for 
the AFDC's, the percentage receiving 01 benefits according to the 
01 benefit files ranged from 9*8 to 11.7 percent while the survey 
accounted for between 4.7 and 9*2 percent. 

21. EPPIS is another source of information on referrals to EWE P. This 
source relies on EPP staff to complete a form that indicates an 
individual has been referred to EWEP. However, since EPP staff had 
little involvement with EWEP, the forms may not always ha*e been 
submitted on a timely basis, and referrals in EPPIS may thus be 
understated to a greater extent than in the logs. Hence, EWEP logs 
are used as the main source of information on EWEP referrals and 
participation throughout this report. 
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22. For example, the response rate for the long-term female welfare 
recipient sample in the National Supported Work Demonstration was 
80 percent for the 27-month interview. (See Hollister et al. f 
1984.) The response rate for female WIN registrants in the 
Louisville WIN Laboratory project was 87 percent for a six-month 
interview, and for a sample of female teen parents in Project 
Redirection, the response rate was around 85 percent for a 24-month 
survey. 

23. For the first report, quarterly earnings data from EPPIS for 49 
sample members with Social Security numbers were verified using a 
direct inquiry procedure to the DI system. The verification 
indicated that there was minimal discrepancy between this manual 
check and the EPPIS data and hence, no evidence of incorrect 
matching. Discrepancies, primarily due to late reporting of 
earnings by employers and corrections initiated by DI Benefits 
Claims staff, occurred in only two cases, and only for the most 
recent quarter. 

24. At least one month of data were missing for 9.3 percent of the AFDC 
sample and 10.6 percent of the AFDC-D sample throughout the 
follow-up period. The County of San Diego had considerable 
difficulty matching its AFDC payment and case status records to the 
identifiers for the sample members. 

To assess the quality of welfare data in EPPIS, a comparison was 
made between a sample of 188 cases in the EPPIS system with infor- 
mation obtained from the microfiche of the original payments 
records from the San Diego Department of Social Services. For 
almost all persons with recorded welfare payments, the match 
between the microfiche and EPPIS was exact. However, for those 
missing welfare records in EPPIS, the microfiche often indicated 
payments were made. Of the 55 oases with missing welfare records, 
the microfiche showed some payments for 45 percent and no payments 
for the remainder. When the EPPIS record indicated that 
information on AFDC payments was missing for a specific month, a 
value of zero was entered if the record showed denial of welfare or 
deregistration due to sanctioning around that time period. 

25 • Bnployment and earnings impacts for the complete October 1982 
through August 1983 sample were recomputed, incorporating the 
individuals with missing welfare grant payments data. On the 
whole, differences between these and the main results of Tables 3.2 
and 4.2 were minor. The supplementary Impact estimates were some- 
what lower although the significance levels remained the same for 
the eight cumulative impact estimates. Only one impact estimate 
changed from positive to negative. The largest difference in 
impacts was for AFDC-D earnings gains in both experimental groups, 
but none of these impacts was significantly different from zero. 

The reader should not automatically infer that welfare impacts 
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would also change by only a small amount if valid welfare records 
were to become available for the missing data points. However, 
given the low overall rate of missing data 9 and the fact that these 
data were distributed evenly across research groups, the actual 
amount of these missing payments would have to differ substantially 
across research groups to reverse the main conclusions of this 
report. 



CHAPTER 3 

1. For the impact analysis, data were available for only 3 t 231 of the 
3,591 sample members because 10 percent lacked welfare and, to a 
lesser extent, CIS demographic data. 

2. Since random assignment occurred at the point of application to 
study the upfront job placement effort, the experimental groups 
contained individuals who both did and did not register with EPP as 
well as those who did and did not participate in program acti- 
vities. This was the case because measured characteristics of 
participants could be identified only after the program began. 
Given the research design, if impacts on participants alone had 
been studied, it would have been necessary to single out, within 
the control group, a similar subgroup of individuals who would have 
participated if the program had been available to them. This is 
virtually Impossible, since so many unmeasured characteristics, 
such as motivation and situational circumstances, are usually 
related to the fact of participation. Thus, the research design 
combined the groups in the experimental sample. 

3* Table C.2 uses a base of all research sample members who registered 
with EPP or WIN at some poi nt dur ing the ni ne-month f ol 1 ow-up 
period. This appears justified since registration rates for the 
three research groups were quite similar except for the AFDC-U 
controls, as indicated in Table 4.1. Further, among those appli- 
cants who never registered, 13^2 percent were receiving welfare in 
the ninth mc::th. 

k. See Chapter i) of the second report for a compl aL* discussion of the 
findings from the case file study. 

5* Unemployment Insurance (01) records report earnings by calendar 
quarter (January-March, April-June, etc.). Thus, depending on when 
in the calendar quarter an individual applied for welfare, the 
quarter of welfare application reflected zero to two months of 
post-application follow-up. Thus, the quarter of application is 
not a true follow-up quarter for earnings. Because time lags 
occurred between random assignment (i.e., welfare application) and 
the next activity (usually program registration but sometimes 
employment), the calendar quarter in which random assignment took 
place probably reflected little applicant activity and mostly 
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earnings reported through the DI system from jobs held before 
applicants applied for APDC. As a result, the quarter following 
the one of application (quarter 2) is considered the first quarter 
of follow-up for impacts on employment and earnings, and reflects 
behavior during the three-to-five-month period after welfare 
appl i cation. 

6. There is not necessarily a one-for-one relationship between percent 
«a ployed and earnings reported in a given quarter, since an indi- 
vidual is counted as employed if the earnings are one dollar or 
several hundred dollars. The level of quarterly earnings is 
affected by several factors: at which point in the quarter an 
individual becomes employed (and, hence, the total number of weeks 
worked in a given quarter), the hours worked per week and the 
average hourly wage rate, A low level of earnings, for instance, 
can reflect many situations: a large number of individuals who find 
jobs toward the end of the quarter; part-time jobs; jobs with low 
hourly pay; or a combination of all these factors. Since UI 
earnings records data mask the extent of the work effort and types 
of jobs held, percent employed is a more useful outcome measure 
than the level of earnings, 

7* As discussed in the second report, job search In San Diego did not 
seem to affect the types of jobs obtained by experimental s, which 
were similar to those of controls at least during the six months 
after welfare application, according to the applicant survey, The 
average hourly wage rate for all AFDC-lTs with jobs was approxi- 
mately $6.50, considerably higher than the $H,50 recorded for 
employed AFDC's. AFDC's also worked slightly fewer hours each week 
(about 33) compared to the almost 40 hours of employed AFDC-U's. 
Most of the AFDC group had jobs in service industries and retail 
trades, while the AFDC-U's worked in manufacturing and construction 
industries. 

The workshops also did not appear to affect job retention: 61 
percent of the employed AFDC oontrols as compared to 52 percent of 
the Job Search/EHEP and 59 percent of the Job Search experimental s 
were still working at their first Jobs at the end of the six-month 
follow-up period of the applicant survey. The job retention rates 
were simi . *r across research groups for the AFDC-U's, 

8. The ' c design measured outcomes beginning at the time an 
indii ii submitted an application for welfare. While program 
impacts on the initial decision to apply for welfare cannot be 
determined, the possibility of deterrence due to individuals 
withdrawing their applications, as well as denial of grant applica- 
tions and discontinuance of welfare grants, can be examined, 

9. During the study period, California deducted mandatory payroll 
taxes from the gross earned income of AFDC applicants and 
recipients before applying the deductions for work expenses, 
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child-care costs, and the $30 plus 1/3 disregard. This practice 
conflicted with the rules established by D. S. Department of Health 
and Human Services following OBRA. California continued to apply 
the standard deduction, however, under the order of a Federal 
Appellate Court and until the passage of the Deficit Reduction Act 
of 1984 (DEFRA) . 

10. MDRC conducted a special study of the relationship between earnings 
and welfare benefits for working recipients for the Congressional 
Research Service. This case study was done in four areas including 
San Diego, using as a basis the impact samples from MDRC 1 a Work/ 
Welfare Demonstration. For a detailed discussion of the method- 
ology and findings see Goldman et &l. , "Relationship Between 
Earnings and Welfare Benefits," 1985. 

11. The MDRC study described in Footnote 10 found that approximately 14 
percent of the San Diego research sample recorded both welfare 
payments and earnings within the same month. This compares to only 
9 percent of the study sample in Virginia, 8 percent of the study 
sample in Maryland and about 2 percent of the study sample in West 
Virginia. 

12. See the second report, Goldman et al. , 1985, pp. 92-93. 

13. For discussion of the EWEP referral and activity process, see the 
second report, Goldman et al. , 1985 pp. 62 through 69. 

14. Calculations of the EWEP add-on impacts for those completing the 
workshops without a job and those who did not, involved segmenting 
the two experimental groups — Job Search and Job Search/EWEP by 
workshop completion status — and comparing outcomes for each 
subgroup. This approach seemed reasonable since there was strong 
evidence that for both program models, the job search workshops 
were similar. As indicated in Appendix Table C. 4, average days 
attended and completion status were similar for both experimental 
groups. Further, the demographic characteristics of completers in 
both experimental groups were similar (as indicated in Appendix 
Tables C.5 and C.6). 

15. During the later application period, there also appeared to be some 
EWEP effect on earnings for noncompleters, but the effect on 
completers, particularly for employment outcomes, was greater. See 
Appendix Table C.8. 

16. MDRC Board of Directors, 1980. 

17. The two applicant groups also differed demographically in one way 
because of a change in program guidelines. Prior to January 1983, 
women with children under the age of six (formerly WIN volunteers) 
who were out of the home for more than brief and Infrequent periods 
were mandated to register with the program — either the experiment- 
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al or WIN programs — and therefore were randomly assigned and 
included in the impact analysis. After January 1983, these 
individuals were no longer randomly assigned or included in the 
sample. 

18. Receipt of two or &ore sources of income in any one quarter does 
not necessarily mean that these income streams were being received 
simultaneously. 

19. See the second report, Goldman et al. 9 Chapter 5, Section H and 
Hoerz et al. , 1985. 

20. In Chapter 4 which examines the AFDC-O's, the extent of prior 01 
benefit receipt is also analyzed as a separate subgroup. In the 
AFDC oategory, however, accurate impact estimates could not be 
calculated for this subgroup since there were so few indivdluals 
who had received 01 benefits in the six months prior to 
appl ication. 

21. See, for example*, the results of the Louisville WIN laboratory 
demonstration of Job Search in Wolfhagen, 1983; Hollister et al., 
1984, on the Supported Work Program for the longer-term female 
recipients; and Brown et al., February 1983, on the Employment 
Opportunity Pilot Project. 

22. Bane and Ell wood, 1983* 



1. See Footnote 7 in Chapter 3 for a discussion of the types of jobs 
held by the two assistance categories. 

2. As noted previously, in July 1984 rules for sanctioning AFDC-O's in 
EWEP changed. See Footnote 15 in Chapter 2. Essentially, while 
the federal AFDC grant is still closed for a sanctioned AFDC-0, 
state aid funds continue to assist the family except for the person 
sanctioned — similar to the AFDC rules. Since the administrative 
records used as a source of data for this evaluation contain grants 
that include both federal and state monies, this new ruling could 
cause lower grant reductions for the AFDC-O's in EWEP during the 
last few quarters of follow-up. However, the new rule was not 
implemented until after September of that year, and because few 
were left in the EWEP component by that time, the change should not 
affect the welfare level of many sample members. 

3. It is of interest that there did not seem to be any changes in 
program performance between application periods. As with the 
AFDC's, participation and other activity levels were similar in 
both application periods, although for the later Job Search/EWEP 
group, participation in any activity — EWEP Included — was slight- 
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ly lower. One other notable but not statistically significant 
difference was the higher sanctioning rates for the later Job 
Search only applicants. (See Appendix Tables D. 1 and D.2) 

4. See the second report, Goldman et al. , 1985, pp. 137-145* 

5. The impact estimates for the subgroup of those on welfare for more 
than two years are less precise than those for the other subgroups 
since only 170 AFDC-0 applicants in the three research groups had 
reoeived welfare for that length of time. 

6. Categorization of AFDC-0' s by recent work history is direotly 
related to AFDC-0 eligibility. Individuals in two-parent 
households are eligible for welfare if they show attachment to the 
labor force during the year prior to application. Attachment is 
defined as having had six or more quarters of work within any 
13-calendar quarter period ending within one year prior to the 
application -for AFDC-0 or having received 01 benefits within the 
year prior to application or having been eligible for UI benefits 
in the year prior to application. Thus, AFDC-0 f s may not actually 
have worked during the year prior to application but had to have 
had some recent employment history. 



CHAPTER 15 

1. TWo of these benefit-cost evaluations are especially noteworthy 
because they are of programs that served AFDC recipients. See the 
evaluation of the National Supported Work Demonstration by Kemper 
et al., 1981; and the evaluation of the Employment Opportunity 
Pilot Projeot by Long et al. f 1983. 

2. Long and Knox, 1985. 

3. However, program participants are also taxpayers and — as dis- 
cussed in the "Tax Payments" section of this chapter — one of the 
effects of EPP Job Search and EWEP is to increase the amount of 
taxes they pay. 

%. The experimental-oontrol differences in means were not regression 
ad J usted. 

>. However, social demand is reflected by cost estimates only if the 
estimated market costs reflect both the marginal costs and marginal 
benefits of the resources. This need not be the case, however, 
because of market imperfections, the inability of government to 
accurately interpret social demand for public goods, and other 
faotors. See Kemper and Long, 1981. 

i. These estimates were made using data from the Job Search and EWEP 
attendance logs and EPPIS. They include inactive time between 
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application for welfare and the beginning of program participation. 



7. Supervisors were asked to estimate the nunber of hours it would 
take regular workers to do the same work done by participants 
during the hours they were assigned to work at the agency. The 
ratio of estimated regular workers 1 hours to participant assign- 
ment hours (for the worksite survey sample) was then multiplied by 
the EHEP assignment hours for those who participated in EHEP (for 
all experimental s). The assignment hours estimates for EHEP parti- 
cipants were made using data from the EHEP logs maintained by the 
County of San Diego. 

8. Specifically, average EHEP assignment hours were calculated only 
for those months in which participants worked at least one hour. 
This estimate differs from the one used in the interim benefit-cost 
analysis, which included a certain amount of assignment time when 
participants were not working (for any of several different 
reasons) and thus overstated slightly the value of EWEP output. 

9* This estimation methodology is described in more detail by Long and 
Knox, 1 985. 

10. See Chapter 5 t Goldman et al. , 1984. 



12. This is a standard economic assumption made in analyses of this 
kind. The assumption implies that employers will not pay compen- 
sation in excess of the dollar value of an employee's contribution 
to output. This allows an estimate of the value of the net 
increase in output due to EPP/EHEP based on observed earnings 
differences. However, experimentals and controls may obtain jobs 
in noncompetitive labor markets, notably in the public sector, 
which may result in some amount of error in the benefit estimates. 

13. Using microstomia tion techniques, Sneedling estimated the value of 
fringe benefits as 17.9 percent of wages and salaries for workers 
earning less than $10,000 in 1 979. See Sneedling, 1981. 

14. However, in producing this output, EHEP participants bear out-of- 
pocket costs that are treated separately in this analysis. These 
costs are discussed later in this chapter. 

15. Most agency supervisors and managers interviewed as part of the 
worksite survey indicated that the work performed by the EHEP 
participants was important to the day-to-day activities of their 
agencies. Indeed, a substantial number indicated that the work had 
been regularly done until recent budget cuts had forced agencies to 
make staff reductions. For a detailed discussion of the relation- 
ship between supply-price estimates and the demand for output such 
as EHEP produces, see Kemper and Long, 1981. Given the framework 



11. Ibid. 
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laid out by Kemper and Long and the results of the worksite survey, 
it is likely that the average demand price for the output is below 
the estimated supply price, but not necessarily greatly below it. 
See Long and Knox, 1985, for additional details. 

16. Osing data from the worksite survey, it was estimated that 3 per- 
cent of the work dona by EtfBP participants would have been perform- 
ed by employees who would have been hired in the absence of the 
EVEP program* However, this estimate is not statistically differ- 
ent from zero, and it is evidence only of short-term displacement. 
Longer-term displacement is a very complicated issue and reliable 
estimates of it are almost impossible to make. See Long and Knox, 
1985i tor additional discussion. 

17. Tax liability was imputed on the basis of tax rates and regula- 
tions summarized In The D.S. Master Tftx guides r 1QB3 and the State 
Tax Quftde , as well as average consumption data for low- income 
households from the U.S. Bureau of the Census. 

18. Differences were computed using 01 benefits data on the entire 
research sample through March 1985. The short-term differences 
estimated for the second report were made using 01 records for a 
subsample of experimentals and controls who reported receiving 01 
payments in the applicant survey (See Long and Knox, 1985). 

19. Survey differences were multiplied by six to estimate overall 
differences during the observation period; see Long and Knox, 1985, 
for discussion of the estimation procedure. The differences were 
assumed to apply to only the early applicants covered by the 
survey; the differences were not extrapolated. 

20. The estimation procedure mirrors the Food Stamps benefit calcula- 
tion rules that apply for eligible households. First, countable 
income was estimated as the sum of earnings, welfare, and 01, minus 
the earnings disregard (18 percent of earnings) and medical and 
child-care deductions (estimated using MediCal and child-care cost 
data). Second, the benefits for which households are eligible were 
calculated as the maximum payment level minus the "expected food 
contribution, " which was computed based on the countable income. 
The short-term estimates presented in the benefit-cost analysis in 
the second report were made on the basis cf applicant survey data 
(see Long and Knox, 1 985) » not this procedure. 

21. MediCal payment and enrollment data covering fiscal year 1983 were 
obtained from the MeqiCal Status Report (June 1983) and Services 
and Expenditures Monthly Payment Report (Report MDP-024), both 
produced by the California State Health and Welfare Agency, Center 
for Health Statistics. 

22. The 01 estimates reported here are lower than those presented in 
the second report for three potential reasons. First, the estima- 
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tion procedures are different (see Footnote 18 above). Second, the 
subsample used to estimate UI differences in the second report 
excluded persons who applied for welfare before January and after 
June 1983 (who were not in the applicant survey sample); those late 
applicants on average showed reductions in DI payments compared to 
the increases for earlier applicants* Finally, the data used for 
the second report extended only through December 1983, while the 
data used this time extend through March 1985* 

23. Administrative oost data were obtained from the Workload and Cost 
CflBMUAflgfl Rgpgrt (June 1983), produced by Financial Management 
Services, California State Health and Welfare Agency; the Medical 
Status Report HQfiqi; and the Budget of the P. S, Government 
Appendix: Fiscal Year 1983. 

2H. The participation was not intended. However, a few controls 
managed to find their way into this program, which was run by the 
same staff who operated EWEP. The program was essentially identi- 
cal to EWEP except that participants worked fewer hours per month. 

25* Attendance data on ESP enrollees were obtained from the County of 
San Diego, and enrollees were matched to members of the experimen- 
tal and control samples in order to estimate experimental-control 
ESP enrollment differences, 

26. Regional Employment and Training Consortium (RETC) cost and enroll- 
ment data covering fiscal year 1983 were provided to MDRC. These 
indicated that the average cost of training was $918 per partici- 
pant. The oost of the Food Stamps Wcrkfare program was estimated 
using time-study data on the staff hours devoted to the program 
(the time study is described in the "Program Operating Costs" 
section of this chapter), which were valued according to pertinent 
salary rates and then marked up for fringe benefits, nonpersonnel 
expenses, and overhead; the cost per participant was then calcu- 
lated using participation data supplied by the County Department of 
Social Services, For details, see Long and Knox, 1985. 

2?. The present discounted value of extrapolated future benefits was 
estimated by multiplying the base period estimate by a single 
extrapolation factor that takes into account the other three 
elements — the time horizon, decay rate, and discount rate. For a 
specification and discussion of the factor, see Kemper, et al., 
1981. 

28. This estimate was made by Mary Jo Bane and David Ellwood using 
longitudinal data on AFDC families; see Bane and Ellwood, 1983. 

29. Decay rates were oomputed as the percent reductions in experi- 
mental-control differences from the first quarter after program 
participation (which was the second quarter for the Job Search 
program and the third quarter for Job Search/EWEP) to the last 
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quarter of available data. Positive quarterly earnings decay rates 
of between 2 and 39 percent were computed for all groups except 
early AFDC-0 applicants (October 1982-March 1983) assigned to Job 
Search/EWEP and late AFDC applicants (April-August 1983) assigned 
to both programs; the negative decay rates that were computed in 
these cases were treated as zero decay for the purposes of extra- 
polation. Quarterly welfare decay rates were positive in all 
cases, and ranged from 5 to 22 percent. 

30. The choice of a discount rate has been a source of continuing 
debate both in government and in the economics literature; see, for 
example, Banke and Anwyll, 198O. While there is no "correct" rate, 
5 percent is within the range of rates usually used in benefit-cost 
analyses. 

31. The exoeptions are the earnings and fringe benefits estimates for 
applicants assigned to Job Search; the adjusted estimates for the 
entire observation period were $200 per experimental lower for the 
AFDC assistance group and $331 higher for the AFDC-Os. All other 
differences between unadjusted and adjusted estimates for earnings 
and fringe benefits and for AFDC payments were less than $150 per 
experimental. 

32. All DSS and EDD staff who worked in EPP and/or EWEP in the local 
offices completed time sheets during this two-week period. Copies 
of the time sheets and the instructions used, as well as descrip- 
tions of procedures and results, are provided in Long and Knox, 
1985. 

33* The random assignment process is entirely due to the research. 
Eighty percent of the line staff time spent on EPPIS was consider- 
ed research-related because, in the absence of EPP/EWEP, manage- 
ment reporting (similar to EPPIS) would have been done only for a 
20 percent sample of clients. Part of other program reporting (but 
none of the record updating done by social workers) was judged to 
be research-related. TWenty percent of both local and state 
administration was estimated to be research- related based on 
interviews with administrative staff. 

34. EPP operations reached an "ongoing" status by the end of Septem- 
ber, but EWEP operations started up and developed gradually dur- 
ing the quarter. Because recorded EWEP enrollment days during the 
first quarter were 80 percent below their level in the subsequent 
two quarters, although costs were the same, 80 percent of the first 
quarter EWEP expenditures were judged to be "start-up costs." 

35. These data were obtained from Table 3.2, "WIN Registrant Status," 
in statewide WIN ESARS reports covering the five quarters over 
which coat data have been collected (October 1982 - December 1 983 ) . 

36. The BiEP attendance log data extend only through February 1984, 
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Thus, EWEP enrollment day differences were adjusted to cover the 
period of March- September 1984 using EPPIS data, 

37. For the purposes of EWEP cost estimation, all assignment days 
between referral and work-assignment completion were taken into 
account. However, in computing the value of the output from EWEP, 
only assignment days for months in which participants actually 
worked were used. 

38. The gross oosts of operating EPP/EWEP were $736 per experimental 
for the AFDC Job Search/EWEP group, $668 for AFDC Job Search, $839 
for AFDC-U Job Search/EHEP, and $695 for AFDC-U Job Search groups. 
Costs are averaged over those who participated and those who did 
not. 

39. The Bnployment Development Department's Petty Cash System, an 
automated reporting system for recording enrollee allowances and 
expenses, was used for making these estimates. The estimates of 
allowances reported In the second report used Petty Cash data that 
were incomplete, necessitating adjustments. Complete data, how- 
ever, were used in this analysis. 

40. The gross oosts of allowances and support services for the Job 
Search/EHEP group were $39 and $43 for the AFDC and AFDC-U 
categories, respectively. For the Job Search group, the gross 
oosts were $35 and $37. 

41. As noted in Footnote 6 of Chapter 4, individuals from two-parent 
households are eligible for AFDC-D if they worked for six or more 
quarters within any 13-quarter calendar period ending one year 
prior to application or if they received or were eligible for DI 
benefits within the year prior to application. 

42. Some AFDC cases are not eligible for federal matching. As a 
result, the actual breakdown for AFDC payments during the period 
covered by this analysis was 49.9 percent federal, 44.8 percent 
state and 5.4 percent county; the breakdown for AFDC-U payments was 
49.5, 45-1 and 5.4; and the breakdown for administrative costs was 
49.7, 25.2 and 25.1. 



1. For further discussion, see Long and Knox, 1985. 

2. This annual decay rate in earnings for WIN clients was estimated by 
Ketron, Inc., 1982. 
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